DOCOHENT BBSOap 



ED 209 «51 

J. 

.AOTHOB. 
• fiTLE 

' INSTITOTION 



SPONS AGfeNCy 
POB bATE ' 
GRANT . • 

•»oTE : ' * 

EDHS 5I^i;CE 
DESCRIPTORS 



IDENTIPfESS 



•C£ 030. 42? 



- Hahiir Andrew; Friednaiir Barry 
The Effectiveness of Two Job Search. Assistance 
Programs 'for Disadvantaged XoutLI Pinjil Report* / 
Bran9eis, O.niv* r Malthaair Hass. florenfce He^xet^ 
Graduate. School for Advance'd Stjidies in- social* 

' Welfares * ' ^; 

• Office^bf YDUtU Programs \DOL) r Wash'ington, D.C. 

, 81 ' ' ; 

. DOL-99-B-"l"BT9-33-U1 * ' ' 

'*222p. ' ^ . ' 

^'MF01ftC09 Plus Postage* . - '\ 

A^dqlescents; 'career Counseling;- Comparative VAnalysis; 
Counselor Hole; *Deaonstration Programs; \' 

♦ Disadvantaged Youth; Employment , Programs; Bmplbymeni 
Services; Evaluation; Federal Programs ;**JOi) - ^ 
Placement; *Job Search* Methods^ jdij SKilis; *Prograin 

* Ef fective;iess ; .Program ^Evaluation; Success; Summative 

Evaluation; loung Adults; *ioutb Eitfpioyment 
^ Bassachuse^tts * (Cambridge) ; Pennsylvania (wxlkeg 
^•Barf e) ;^ routh Emplo'yment and Demonstratioft "Projects 
Act' - . . r 



ABSTRACT ... ' ' > ^ 

* ^ \ < ^ Two job search' assistance programs* for disadvantaged 
■youths f anded* uttder the Youth ^Emplpyment and Demonstrations Project 
Actr^' were evaluated for both operation and impacts The two programs 
were the Cambrl^gfer Massachusetts r Job Factory r. waich paid youths a 
stipend^ f or^^lom^ the ••job" of finding a job, while providing group 
actiritiesr resume wrdting, S?ob'Sear'ch gj&i^ls.and placement 
assistance: and. the Hd,lkes-Barrer . Pennsylvania, iorkshop, ' which 
assi^gned participants t.p on^ of three treatment? groups to receive 
eit^her individtal care.er counseling and job placement services, 
career counsel^g, jo*!3 placement services, * and group Job search 
skills iro^^rk^hopsr or career counseling and job search skills 
workshops* No stipend was>paid in the -Pennsylvania project. In the 
Cambridge group, 203 youths' were enrolled in the Job Factory while 
166 served as :cantrols: 396 "youths" were enrolled in tiie 'tfiree 
treatment groups In tfilkes-Barra^The. -process evaluation showed t:hat 
the Job Factory functioned fairly^smoothly because^ it was a" 
modification of an^ existing prbgram, whil.e the workshop experienced 
difficulties in impleii^entation because of its "top-down" moael. The 
impact* evaluation found that the Job Factory had a sui)'Stantial effect 
.in getting youth to 'work' quickly, although these effects may not 
continue ^on'g-term, while in the Workshopr^ there w6re ^no significant 
differences in the rate of job finding for the three groups. Job"' 
Factory participants found .mod'erately better jobs than the controls, 
while ^ no major differences in the groups- were found in the workshop ^ 
participants. In Cambridge,' attitud^^/knojiledge areas did not 
contribute tx^ jol!) finding, while in tfilkes Bapre,' job search skills, 
were a signi.fica^t component of job findi'ng* Overall, it was found 
that the intensity of the search fostered by the moral support t)f 
counsellors ^as the-mpst significant component in the jo.|) search ■ , 
assistance p^ogramsi^ (KC) 
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Executive Surtimary ^ ^ . 

High, rates of unemployment among the nation'^youth led the 
Congress to enact the Youth Employment afid Demonstration Projects Act of . 
1977 (YEOPA). This^Act recognized that detailed information on Vouth 
employment" problems and the effectiveness of alternative youth employment 
and training programs were not ava^JabVe to Congress, The Act authorized 
basic research, demonstration programs and program evaluation, ' 
^In particular, one type of program authorized through VEDPA is 
Job Search Assistance (JSA). JSA programs make an effort to improve 
connections between youth and employers, OVdinarily, the job market process 
operates to match the demands of employers with the labor supplied by 

-jv&rkers. High unemployment^among Ibw incole youth occurs" primarily because 
of the inadequate, demand for workers with the skill, work experience and ^ 
work patterns of low "income youth. As a, result, most youth proqrams focus 
on raising the effective demand for low' income youth and/qr on improving 
the education, skill and work experience of low income youth. 

Job search assistance prograjns go beyond the traditional treatments 
of improving skills or stimulating demand. Instead^, JSA is intended to . 
improve' skills for job search by developing connections with, and knowledge 
of the labor market, ^ The U. S. ^Department of Laboc financed several demon-^ 
strations to test the effectiveness of programs that educate low income 

,Vouth about the job market, the nature of Jobs and jo^ sea^rch techniques. 
These job searcl^ assistance ^(JSA) programs are .compri^sed of courses, work- 

"shops, counseling, role playing, simulfiteci job ose^rch, and actual job searCh 
Job search assistance programs teach participants how to prepare resum^es. 



prepare information over^^the telephone or during an interview, and impart 
cormnon sense advice on how to approach employers and get jobs. ^ ' 

\ In early 1979, several agencies that had been providing job search' 
assistance were selected as sites in a national project to determine whether 
irect instruction irv job .aclqtjisition skilfs eases the transition of disad- 

)italed youth into the labor market. One nrvogram, the Job Factory, ^is 
run-bylthe Cambridge, Massachusetts Office of Manpower Affairs (CETA). 



The other program is called the Workshop. It^is run by a community basejo 
organization in Wi 1 kes-Barre, Pennsylvania, called the Youth Employmentf 
Service (YES). This study reports on firilings ^from an evaluation of both 
programs. ' ' • ^ 

The Cambridge Job Factory .. * 

♦ 

The Cambridge Job Factory was organized in five cycles of'four weeks 
each. , The first and last cycles were planned to serve 50 graduating high school 
seniors. Cycles 2-4 were funded to serve 50- unemployed youth each, in- 
eluding both high school graduates and dronouts. No in-school youth were 
to be served by" the Job Factory program. Finally, youth who found jobs in' 
the first. three weeks of the various Job Fa.ctory.^ycles were to receive ^ ."^ 
bonus payments (in addition to the minimum wage subsidy) equivalent to two 
days of program participation. • ^ 

To be.eligiJDle fqr the program, youths had to satisfy CETA-establ ished 

family income requirements. They wer^ then randomly assigned by -the re- 

searchers to either the experimental or .the control group based on an assign- 

* ♦ • 

ment procedure which ensured that the twd groups 'got ah equal distribution 
of persons by sex, age and ethnicity. * " . ' " 
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The character of"the Job Factory was to represent tKe real work 
environment. .Participants .were hired ^nd paid to get a ji?b. The program 
cbnsisted of four components; orientation, group activtties, workbook 
exercises, and actyal job search. Orientation introduced participants 
to the history of the Job^ Factory, its success record, and i*s expecta- 
tions. • Participants were expected to treat the proqram as they would a 
job.-> The job in the Job Factory was to get 'a job.* Group activities 
included classroom exercises, in job f inching and ''decysion making" exer^ 
cisfes designed to foster creativ'fe problem solving. (Participants also viewed^ 
and discussed videotafe on job finding and met "role model" guests. 

Ee^h participant was assigned workbook exercises which helped structure 
his/her job finding activities. The creation of "selling too]s" such«^s 
introductory letters, resumes, and references was^stress%d. The develjopment 
of a list of potential employers was" also crucial. Interviewing skills were 
honed with practice. interviews which were .filmed and analyzed. After the 
first week, attention was focused oh actual «job search activities. Each 
program cycle lasted up to four weeks. - • 
The Wilkes-Barre Workshop ^-.^ ^ , - V 

The Wilkes-Barre design requiredf random a'ssignment of participants 
to one of three treatment groups. Each group represented a different type 
of job search assistance. , Rroup 1 was to^eceiva individual career counseling 
an^ job placement services (a type of job bank listinq). Group 2 was to 
receive career counseling, job placemeat services and special group job 
search skills workshops. Group 3 was to receive carreer counseling and the";; 



job search skills worksliops. Participants in^Group 3 would, however*, be 

encouraged to finer jobs on their own, since they were not to receive the 

job listings in phe'plePcement service component. ^ 

For Veseairch purposes, it is corlvenier^^ to think of 15roup 1 in 

^Wilkes-Barre asr receiving a "lean" kjnd of' job sear'ch assistance, pferhaps 

similar to that provided by traditional labor mark^ intermediaries, job 

listing and general one-to-one caper counseling. - Group 2 oiay be thought 

of as providing the full range of job search assistance services- that a 

community group like YES is capable of providing. ^Group 3 was to receive 

.the same as Group 2, except f^r the job placement services, that is, youth 

had to find a job^n their own. Group 3 may, therefore, be considered a 

reference groug^of youth who received job search assistance but were com- 

plet^ly ^self-directed in their active job search. 

' /iiH)e eligible foi^ both programs, youths had to satisfy the following 

requirement established by CETA regulation's: be between the-gges of 15' 

and 21; be^unemployedk and satisfy the low-income guidelines set by the 
« » • 

Office of Management and Budget for families of different sizes. 
Sample , ' • • 

^ The total number of youth on which the Cambridge §inalysis is based-/ 
was 368^; 203 .in the Job Factory (experimental) group and 165 in the control 
group. In Wilkes-B|rf^396 youth-were enrolled in the three treatments. 
Process Study Results 

The two job search assistance programs v^re conceived, developed, 
and shaped by entirely different circumstanced. The Cambridge Job Factory 



used federal funds to modify an existing program model that in. the pre- 

< ' ' , 

demorvstration phase had undergone considerable experimentation and 

refinement. The demonstration funding did viot create speci'al constraints 

on the sponsor organization, partially because^ the ^latter was the source 

for the demonstration program design. In contrast', the. origins of the 

Wilkes-Barre Workshop'i 11 ustrate a. "top down" model of implementation in 

which federal requirements, ranging from program design to recordkeeping," 

were followed with considerable difficulty. Almost overnight, the Workshop 

was required to switch from an ."open door" youth-serviiig community agency 

to a formal employment program for disadvantag^ed youth. Not surprisingly, 

the. pj^ogr^m- was changed substantially- from the time "it w^s proposed initially. 

Once initiated, the Workshop did not run smoothly. -The process study 

Identified the follovnng difficulties in the Wor,k^hop's implementation:" 

•">■'•* 
^ * • undeYe'nrollment by^ nearly half the propt/sed number of youthV 
served; ' ' 

^ ' ' ' , ^ . ' >^ ^ 

^ difficulty in income verification; 



• 



recruitment methods based on an over-reliance on "walk-ins^'i;t'^ 



} 



recruitment difficulties traced to the fact that YES'did not ■ 
offer sti-pends Tor participation; 

f the failure to deliver a^ll planned services to the- appropriate' 
participants— 39 percertt of assigned youth did not receive job' 
' -search skill workshops while 25 percent of assigned youth did ^ 
not participate in one 'job interview as part qf the job place- 
ment service; 

• tot^l direct service timejwas extremely limited and typically 
was less than ten hours; ^' " - . 

# personnel experienced frequent turnover and disruptive reaasign- 
ments; the organization lacked effective executive leadership 
during much of the demonstration;. s 
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• young oarticipants^ generally enjoyed and rated as helpful those 

. aspects of the Workshop , program that were stressed, in the service 
^mix, such as counseling. and actual job search; however, tangible 
elements of job search traininci, such as resume writing prepara- 
tion, 'were not enjoyed or valued by the Wilkes-Barre youth. 

The Cambridge Job Factory operated more smoothly than the Wilkes- 

Barre program, -but it v(as not without implementation difficulties. In 

particular, the process s^tuc^y reveals that:' 

• Cycles that, were designed to serve low income graduating seniors 
were the most difficult to implement. Local school systems over- 
estimated the universe of need; other programs operated in the 
summer months that wer§ attractive alternatives to the job search 

i programs; many sertiprs disguised their intentions to return to 

school and were only temporarily unemployed. 

• The importance of stipends for job search participation was 

. dramatically revealed by the failure of the Cambridge program 

to opeipate an unstipehded cycle of the Job Factory. Recruitment 
' improved rapidly' once the decision to pay participants the minimum 
wage for "working'* in th^ Job Factory, was resumed. 

• In contrast to tbe cycles for graduating seniors, cycles that were 
designed to serve youth ijiost in need— unemployed youth, both high 
school graduates and dropouts— reached '87 percent of planned,, 
enrollments and actuallx oy^renrolled the-i:argeted number of 
dropouts. ' . ' ' . 

• Much of the 'effective implementation of the Job Factory cycles 

can be* traced, to the executive leadership of the sponsoring organi- 
zation;. to the utilization of'a pri-vate consultant to get the early 
program i-nitiated; to effective ties wjth community resources; 
and to a stable. and motivated staff.. 
• • * ' 

Impagt Study Results * ^ ' , ^ 

The evaluation considered* differences in the rate of job finding, ^tf\e 

* * 

quality of-jol>s found, and the. persistence of the job finiiing effect. Th.ese ' 
results were examined in the context of a number of channels of* effect--ways 
in which the impacts came about, the channels include work attitudes/ 
knowledge areas, learnable search skills, and intensity of search. The' results 
of the evaluation of impacts are sumnariz;ed below. — 

9 t - ^ . 
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Job Finding ' . ^ 

• Over all Cambrjdae cycles, the difference in job finding rates 
^without control! xig for oth6r factors) as of the first followup 
survey (ten weeks after enrollment) was, 16 percentage points, 
favoring the treatment orouD. the difference in job.fin?ling 
rates diminished for subsequent followup periods. In sum, 

the Cambridge job search program had a large short-term effect, 
but going out' to 45 weeks post-enrollment^ there was no meaningful 
difference. Youth sooner: pr later find jobs anyway, treatment or 
^ not. The effect of the treatment is simply. to speed up the- pro- 
portion fijiding job?. * ' • ' ^ 

• In Wilkfes-Barre, thpre were no. significant differences between- 
treatment groups in rates of job finding .(without controlling for, 

r . Other factors) at nine weeks- after enrollment. ,:rhereafter,- sma1% 
differences appeared with Group 2 (who received placement services, 
rather tlian self-directed job search) having, the lowest rates while 
' ...G^oup 1 (the "lean" approach that did not receive jot) search skills 
workshops) h^d the highest job finding rates. However, ''these 
differences were not significant. ' 

• When variables such as sex, age-, race, public assis^tance, education 
V status and reading level ^re introduced-as controlling factors on 

job finding," participation in the Cambridge JSA^ program was the only 
significant variable. Put differently,' the Job Factory had a. sub- . 
. stantia] effec4: in getting youth to work, 'independent of these 
other factors. In Wilkes-Barre, there -was no significant ef-fect ' 
of different types of treatment on job 'finding. 

y 

Quality and Stability of Jobs Found . , 

• In Cambridge, -wages, hours of work_^ and earnings were* all sl ightJy 
higher, for the JSA youth than for tjie coatrol group. Substantially* 
more jobs were full-time for the JSA group.. In sum, the 'quicker 
pace of job finding for Cambrijdge JSA joath Jed to modestly better-,, 
jobs. . ' • • ' \ 



1 

' . • In Wilkes-Barre,* part-time work was more common than in 

Cambridge. The most enriched treatment group (^Group 2) fount! . ' . 
more full-time jobs than the self -directed group (3) which 
resulted in higher weekjy hours' antl earnings. Otherwise, there 
.were no significant differences betv/een treatment groups in. 
''s- quality of jobs found. * , . . ' . 

• In Cambridge, the rate of jbb leaving was lower f or *j'ob search 
assistance youth than the control group. The data, therefore,- ' 
gave no support to the hypothesis that speecjy job finding ends 

in early .job leaving. 

# In Wilkes-Barre no clear -differences in job stability were ' ^ 
identified for the three treatment groups. Variations in tre'at- 
ment in Wilkes-Barre made no difference in thi^ job holding 
impact. " 

. Work Attitudes/Knowledge Areas ^ ' ' v . 

The study is part of a national affort toxollect uniform data on 
^outfi participants enrol led^in a numf)er of specia] demons tratiions across 
the country,^ funded by the Departm^t of Labor. The effort consists of 
numerous. ifidependent progrjam evaluatton? cfeing ^ common 'tiata base developed 
by the Educational „Testihg Sj^rvic^ (ETS) ^alled'the Standard Assessment - 
Syst^!ft^(SAS)^ -The ETS/SAS ;i gel i^des' a battery of.^even "pre- and>ost- " i 
program (exit) tests that^measure various aspects of '\, 
worJe-OfT^^litations. The seven seal 6s mensure-: Job Knowledge Tfest; Job 
Holding SVills; .Job ^ekipg Skills; .Vocational; Attitude Seal e;^ Self- Image; 
Work Relevant Attitudes; and Sex Stereotyping of Adult Occupations. .Findings 
from an analysis o^tHesg measures include: , ' • ' 



• ; Jhere were' no significant positive 6ains in attitudes/knowledge * ' 
. areas /rom pre- to post-test in eitfier program', .with the excep- 
tion of Vocational Attitudes in, Cambridge. . v . 

' ' " \ • • ^ / "f 

• In a procedure to determine what ^tprs, >n addition to program 
'".treatment, are tied to attitudes/know^ledge* areas, we found tha^ 

{ with the exception of Job Seeking skills in Wi "tkes-Barce* treat- . ' 
ment proup'was ne\?er a significant determinant of attitudes/ \ 
y knowledge ^areas..> The fact that Wilkes^Barre Group 3. (the self- 
. directed job search group who jlid not receive placement services) 
scored significantly lower on job sear(;h skills, when other 
factors are controlled, suggested that the placement services . \ 

were importarj^t in developing j,ob search* skills through a - . 

"learning by. d(^hg" process rather than the formal instrtiction 
in search tecfitrt^uesj^Dur interpretation must*' be -tempered, ^ 
however,* by the fact thlt i:he process study reveals that sefvices^ 
^ were not always delivered as planned. v " . • * 

• In Cambridge, "attitudes/knowledge arpas did not contribute to 
job finding. In Wilkes-Barre, 'Job Search S|w<lls. were a signi- 
ficant determinant of job finding. Thus, in Wilkes-Bar re there 
may be anj'ndirect effect of'treatment on job finding, with ' ^ 

- Groups. 1 and 2 having higher Job Seek'ing ski^lls which 'in^ turn 
•"produce greater job finding. The distinguishing feature of , * ^. 
Groups 1 and 2 Wc^s the ihclusioo of placement services. • ; . 

Intensity of Search . ^ . 

• In Cambridge, JSA youth cited contacts with staff (tiore frequently ^ 

^. than any other item as a .source used itiost hfelpfully in getting first jobs. 
^ Counselors provided emotibnaS support rathan than placement assistance. 

• indicators of- intensity of ^search included the number of applica- 
tions filled and the number of interviews altewted. We found in 
Cambridge tha.t the* intensity of search was significantly promoted 
by^ the' JSA program, most notably for success,ful jo]) finders. In 
Wiikes-Barre, the process study as weM'as'the impact data on 
intensity suggested an uneven pattern of. search effort between 
group§. Limited evidence suggested that Group S-youth inter- 
viewed and filled outjjiflHje ^plications; therefore, the placement ^ « 
services groups J^^J do' less searching. This finding, in 
combination with the data cited previously, suggested that in 

Wi Ikes-Barrev success came from the explicit assistance in putting 

youth into jobs. The program was too diffuse to generate success- , • 

• ful self-directed and rtiotivated s.earch among the participants. ^' 

% In Cambridge through the first follow-up period, when we compare 
weeks to get 'first job among successful job finders , there are 
no meaningful differences in search time 'between JSA youth and 
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control group members/ Thus, JSA leads to more job finding in . 
the short run, but not necessarily to shorter search time among^ 
successful job finders. * ^ . v< 

Prognam Costs * • ^ 

* ' ^Costs per youth served, excluding demonstration. e)^pens.es and 

stipends, were $715 and $324 for Cambridge and Wilkes-Barre respective- 

ly. Costs per employed youth were a modest $1442 and $611 in -CambrTd^re 

and Wilkes-Barre (excluding stipends and demonstration . expenses). 'The 

cost per net net job created through job search assistaitce indCambridge 

was $4468. ' • ' . ^ 

Pojicy Implications . ' ' • ^ 

Job search assistance^ Warks by sustaining interest in active 

search. It -may do this through financial incentives, through aj^rogram 

that is perceived as /*fun" by young persons, or through the fact that 

counselors are titere to marshal and reinforce youthful emergies that ' 

might otherwise be dissipated. .Whether tftere ar6 Ipng-tenn impacts , 

extending into future spells of unemployment from job search assistance 

cannot b§ deduced from our study. In fact, this study shows that 

'there can be significant short-term effects^, but tjiese effects appear 

to diminish over time. ^ ^ . ^ ' 

Successful job search assistance gets youngsters to initiate" their 

search sooner than they had otherwise planned and. to pursue s^earch.mare 

intensively over a period of time. The curricuU of the programs are 

undoubtedly important in attracting youth tS ^nd keeping youth in the 

* • \ 
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programs, but it is not'clear Whether„the various OSA elements actually ^ 
can be said to significantly alter participants' attitudes or knowledge 

• areas. I.t'is the intensity of the program that is clearly very important, . 
This then raises the question of, what sort of incentive it takes - ' 
'to get youth to participate in such a program. We sjiowed that in , ^ 
Cambridge the financiaKstipend used to attract'aad support ^uth 'dur- 

' ing the program was a critical element of job search assistance. When 
the program trted to operate without stipends, it failed. Similarly, ♦ 

^ many of Wilkes-Barre's problems with underenrol Iment^ failure to- 
deliver all planned services, and "low service hours can be attributed 
to a lack of. financial incentive, > . 

The importance of personnel in preparing youth, but more import- 

' antly, in^reinforcing^the search process, was illustrated in both the 

process and impact analyses. Certainly, the frequent staff turnover. 

I ' ' 

nd. disruptive reassignments in Wilkes-Barre influenced the employment- 

' ' ) 

related impacts, , * 

Another important element is program 'design.. The Cambridge 
program is structured .in a way that holds youths- captive long enough . , 
to impart a senSe of urgency and incentive to. their' search. By contrast, 
the Wilkes-Barre program is diffuse and characterized by a lack^f 
^enjoyable group activities, as well as a failure to routinely, follow 
and support the youths during their search for jobs. 

The- conventional wisdom is that job searfch assistance works in 
part ^because of the peer ^support, group dynamics, and other program 
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elements directed at changes in self-esteem, knowledge of , the world- 
of-wofk, and knowledge*j)f the job search process. -In this study, 
Cambridge's short-run success resulted from the high intensity of search 
effort generated by the program's service mix. We would argye that the. 
program activities were important because they were fun and because 
they held the atte]htion of the youth. Jhis does not prov^that the 
conventional wisdom is wrong^-pnly that when'jbb search *£isststance ! 
worked, it succeeded most importantly to the extent it increased the 
intensity of search. Job searc^r assistance is important then not so 
•much for what it teaches but for what it promotes-- job finding. 
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' • Chapter I , • ■* ' 

Introduction 

A. . PTan of Study ^ • , 

This report presents an evafuation of two job search assistance 
programs for youth. The programs /.serve low income disadvantaged youth , 
and are menters'of a 'family of youth employment programs, demonstration 
projects and associated evaluations that were authorized through at 
1977 amendment to CETA, the Youth \ip1oyn\ent and Demonstrations Project 
ActlYEDPA). 'In early 1979, the Department of Labor selected two ageaci 
that had been providing job search as'^istance as sites in a national 
project to determine whether direct instruction in job 'acquisition ski.lls 
eases-the transition of disadvantaged youth into the labor' itiarket. One 
.program is the Job Factory and is run by the Cambridge, Massachusetts 
Office of Manpower Affairs (COMA-CETA). The other is administered by a 
small community-based organization in Wi1kes-Barr6, Pennsylvan-ia called 
the Yd^th Employment Service (YES). ^ TKe YES program is called the 
Workshop; .| . 

^ The ^tudy involves impact and pf^ocess analyses; The impact 
analysis is concerned with the effects of the experimental^ treatments-- th 
job search assistance— on clienVs employmefit and- jgb search behavi.or. . 
We also e)^plore through the impact study changes in work attitudes and 
knowledge' areas related to job^sean<:h procedures/ The impact analysis 
relies .on an experimental design in C^rrbridge which permits comparisons 
of these effects between* a control group and an experimental group. In 
• • • 



Wilkes-Barre, there ,is no control ^roup of non-program participants, 
but three groups of treatment youth are compared to one another. The 
three Wilkes-Bar*re groups receive different leve4% of job search. assis- 
tance. A special feature of ^the^impact analysis will examinee variations 
in treatment^ outcomes acr^osrs^ifferent types of clients. 

The process, study is needed to study the parts of the two job 
search assistance'^programs not subject to experimental variation, as 
well as to evaluate, the experimental treatments in terms of whether • 
they operated as planned. Matters such as how, the origins «f the * 
progratns sTiaped the final design; early implementa^ hurdles, suc^i as 
enrollment;. hours of pgirticipation;. composition, training and turnover 
of personnel; and parti ci pants ' experiences in the programs are all 
examined in the process analysis.'^ A special interest will be to deter- 
mine whether the preceding program elements differed from formal plans, 
since it is now a familiar fact that programs often perform differently 
than originally intended. . . ^ 

The- remainder of this chapter is divided into tavo sections.' The 
first, describes the job search assistance program concept; Next, w'e 
describe the two job search programs evaluated in this study. 

Chapter 2 presents a literature review of oast experience in job 
search assistance for disadvantaged, youth. " ^ 

The process^analysis is presented \r\ Chapter 3. Chapter 4 presents 
.the impact analysis. Chapter 5 presents policy implication^ stfemming. fropi 
the evaluation. ^ . " 
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Appendix A describes the^^two economies of Cambridge, Massachu- • • 
setts and Wilkes-Barre^ Pennsylvania. Appendix B presents the 
characteristics ^of the samples utilized in "the impact chapter. Appendix 
C presents qualitative prqfi le^ of. some clients who participated in _ 
the Cambridge program. Appendix D di-s.cusses a special topic-counselor 
ratings of participants' eiflployment potential. Appendix E d^ribes 
the administration of research instruments. App'endix F presents addi- 
tional analysis tables recommended by the' funding agency. 
B. The Job SearcTTAs si stance Coneept . \ 

Unlike other youth employment and training programs, job search/ 
assistance programs are relatively short, intensive interventions coi/pling 
formal instruction. in Job sea^rch techniques with experience and fre- 
quently Supervision in looking for work. Job search assistance pro- 
grams are distinct from long-tenm* career development approaches, occupa- ^ 
tional guidance, vocational exploration, job pl^^cement, work experience 
.and spectfic skill trailing. Although all of these .interventions are 
attempts to e'kse the transition bf youth into the^ world of work, they 
are different from the focus of this study— dijfect job search assistance 

(JSAJ programs that prepare, ^inform and give practical experience to 

* » * 

current or imminent job seekers. 

* There is widespread public interest ir^ learning^ how to look for 
work; programs intended to meet this i'nterest proliferate. Groups which 
work with special segments of the labor force, womAi, older workers, the 
handicapped, ex-offenders, veterans are developing materials and training 
in job search skills^ Job counseling calumns appear daily in the-press 
and /how-to" manuals inundate the market'. One of €he most popular of 
these is Richard Bolles'-What Cx)lor Is Your Parachute , which sells over 20,000 



copies, per month. There are more than 100 other titles, most of which* 
are designed to increase (some authors claim, ^to auararitee) their 
^readers] slicceas in the labor market. .The best-sellers vary in emphasis, 
but all authors af^ue that successful job search j^^lrA^arnable skill , 
tliat* depends on four steps; a thorough self-assessment, a systematic 
job search approach based on factual information about the" local labor 

marjcet, a carefully prepared resume, and a skillful, relaxed" wterview. ^ ^ 

- > 

All job search assistance programs are-built around the developmer^t of 2 " 

these skills. * ^ . ' . 

> • 

In the past five years, -manpower institutions have. transformed 
job search l^training^AO^oth content and technique for 'their widely varied ' 
clientele. Jot) search tl"ainiha programs nave been operating in the U.S. 

Employment Service, thf Work Incentive Program, the national welfare; : 

neforni Emp^loyment Opportunity Pilot Projects, and are now to be tested as 
part. of one 'model of a work requirement in a new FoocI Stamp demonstration. 
Although there iS much variation ^in specific elements of jqb search trajRing 
programs., they usually follow the general -models established by ea^rly inves- 
tigators and program operators (see, for example, Azrin, 1975, 1978; 
Uthrop,"lf78; Jolinsoh, 1973). \ 

Economists have long ^recognized .the importance of public job search • 
s^^ssistafnce pir^ograms. In the standard' economic model, job search consi'Sts 
of a series of activities which can be gi/ouped under twa» principal head^ 
ings— .exchange of informatton, and decji^^tofynaking. ^Both types of tfcti,vities 
are engaged in by employers and job seekers, and are frequently mediated* 



through governmental Tabor market exchanges (e*g*, the Employment 
Service), or informal Exchanges sucK.as job search assistance agencies 
in -this study. The information which is, exchanged^ may be of the ^ 
general labor market information type (for example, the prominence 
of fast foods establishments' in the industrial mix of the community) 
and specific jgb information. Examples of the latter would W actual 
job openings, pay rates and subjective features' of the jobs,. such as 
hiring preferences of one sort^^ another* 

Three decisions are f^ed by job seekers and ertiployers. The first 
is how to obtain or supply information. For the employer, thi*s involves 
whetjier to. Ijire from among those who appl-y directly to the organization, 
from among referrals from labor market intermediaries, or from posted 
advertisements. For the job seeker^ the information problem involves 
choosing amorjflAChannels of information— friends,' newspapers or direct 
inquiries. " The second decision is'how^^to evaluate the information re-». 
cpived. Here the burden is upon the employer who must assess the differ- 
*^t applicants and make a few offers frofti. among a^larger pool of appli- 
cants. The third decision for the employer and job seeker is whether 
to offer (or accept) a job. ' > , 

Mos-t of the econonic t^ought on job 'search is devoted to theoretical 
investigations of the process of maximizing the net benefits of search. 

o 

Typically, an attempt is made to identify many of the variables involve, 
including non-pecunf ary costs (of., Al|hian,, 1970; Gronau, ^977; Hoi t, 
1970; Mortenson, 1970; Phelps, 1969; Stigler, 1962). A significant subgroup 
of this economic literature is devoted to the development of relation- 
ships between search and unemployment. Few studies investigate the 



27. " . 



empirical magnitude of tl^e variables containedjn the standard search 
model, arvd' fewer still focus on the special problems of disadvarrtaged 
youth. 

Job search training >n the- programs evaluated in this report is 
-designed to inprove the effectiveness and intensity ^of search by young 
men and'women. In addition to increasing success and speed in obtain- 
ing a job, the expected benefits to the participant may also include' 
higher wages, better working conditions, less foregone earnings and 

lower search costs. These benefits may be obtained in the programs in the 

✓ 

following ,ways: 

0 Providing the applicant with general and specific labor 
marke^; information. 

0 ^Teaching the applicant how to efficiently acquire information 
about specific jobs. ^ - ^ 

0 Teaching the applicant how to obtain job interviews. 

0 Teaching the applicant how to present information* to prospect- 
ive employers about him or herself in an effective manner. 

0 Improving an applicant's employabjlity by making him or her • 

4' * 

: more self-confident. 

0 Minimizing the psychological djpsts of job seeking by providing 
various psychological supports, e 
. 0 Increasing the proportion of time devolved to job hunting by. 
offering economic incentives, close supervision, and by 
, p applying pressure.- ^ / 

C. Description of the Two Jot Search Programs 

The funded proposals provided $202,940 in Cambridge and'$164;i62 
-to Wilkes-Barre, to serve 30O and 750 low income disacivantaged youth. 
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respectively.' In Cairbridge, there were to be five cycles of a foiir 
week Job Factory. The first cycle was planned to s,erve ^ graduating 
seniors (who wpuld receive stipends of $3.10 per hour) in the, last 
days of their senior year. Cycles 2-4 were funded to^serve 50 unemployed 
youth each; each cycle would enroll half with and the other half without 
•high school diplomas (that is, graduates and dropouts). Cycle 5 was to 
serve 100 graduating seniors again, -although this time the seniors were 
not to receive paid stipends. The funding require^ that a control group 
of program eligible youth be selected for research purposes in each of 
the first four cycles. No in-school youth were to be served by the Job 
Factory proaram, with the poss^le exception of out-of-school youth 
working on their high school equivalency degrees (GED). Finally, youth 
who found jobs in the first three weeks of the various Job Factory* 
cycles were to receive bonus payments equivalent to two- days of program 
participation. ^---s 

The Wilkes-BarreVesearch design required random assignment of 
participants to one of three treatment groups. .Each group represents 
a different level of directed job search. Group l.was to receive indi- 
vidual career counseling and job placement services (a t^^e of job bank 
listing). Group 2 was to recei/Zecareer counseling, job.plaeerrient 
services and special job searcn skills, workshops. Group S'was'tb receive 
career counseling and the job search' skills workshops. Participants in 
Group 3 would, however, be encouraged to find jobs on their own, since 
they were not to receive the job Ustinqs in the'' placement service 
component. 



For research purposes, it is convenient to think of Group 1 in 
Wilkes-Barre as receiving a "lean" kind of job search assistance, j^rhaps 
similar' to that provided by traditional labor market intermediaries, 
job listing and 'general one-to-one career counseling. Group 2 may be 
thought of as providing the full range of services that a community 
group like Wilkes-Barre' s Youth Employment Service (YES) is capable of 
providing. Group 3 was to receive the same as Group 2, except for the 
job placement services, that is, youth have to find a job on their own. 
Group 3 may, therefore, be considered a reference group of youth who 
receive job search assistance but are completely self directed in their 
'active job search. 

To be eligible for both* programs, youths -had to satisfy the 
following requirements established by CETA regulations: be between the 
ages of 16 and 21; be unemploy.ed; and satisfy the low-income guidelines 
set by the Office of Management and Budget for families of different sizes. 

Finally, assignment in Wilk^-Barre to the three treatment groups 
and in Cambridge to experinent- and control groups was done by a' random 
assignment ^^ocedure developed by the BrandeieS research group. In 
C mbridge, tRe instructions assured that 9n. equal distribution of persons 
by sex, age and.ethnicfty would be assigned to the treatment and control 
categories. In Cycles 1-2, 40- percent of the eligible youth w^ere random- 
ly assigned to a control group' (in ^Cycles 3-4 it was 50 percent) after 
learning that "funding limits |:he number of program slots." There. was no con- 
trol group of youth for Cycle 5 of the Cambridge program. In Wilkes-Barre, youth 
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were randomly assigned to the three groups^ 1n equal proportions- after 
stratifying by age and sex, • 

,,The treatments received by the'majority of youth enrolled in 
the twp job search assistance programs are described^elow. It is a 
summary picture of the services a typical client would receive in the ^ 
programs. The process study in Chapter 3 will describe deviations from 
this descriptive, overview. 

1. Job Facto.r(y - Cambridge 
ai Orientation 

On the first morning of the Job Factory program the parti- 
cipant arrives at 8:00 A.M. to join a large group of 30 to 50 youth. 
He/she is introduced to the program,- its policies and its staff. This 
introductory session lasts half the morning and is' conducted by the CETA 
director and Job Factory manager. In this session the parti cipants> learn 
about the program; particularly .with regard to their individual responsi- 
bill ties. The orientation. CO v^fs:- 

vt History of the Job Factory in CanbHdge, Including its experiences 
with disadvantaged groups, public service employees and yoiith. 

« 

't Statistical report of its successT "this program has a proven , 
, ' ^track record of success..." 

t The Factory is a four wee^ program in which parti cip^s are 
hired to find-a job. The pay is $3.10 for each' hour of 
ticipation- The "work day begins at 8:00 AJ1. and continues" 



This is usually a FridayXfor .two reffsons: the largest' source of "help 
wanted" advertising— the Stjnday newspaper--%nows participants to run 
down a "hot" job lead on Monday; after a)>-intense first session, the 
participant has a weekend to relax ^ 
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until 5:00 P.)Sf. with an (unpaid) hour break at noon for 
lunch : ^ 

f Each "employee" must sign in upon arrival and sign out at the, 
end of the work day* , 

When goinq out on any jbb related activities, an "employee" 
must sign the ""company sign out sheet" posted on tl>e wall/ ^ 
and iji^orm 'a counselor (supervisor) where he/she is going, and 
when the Darticipant is expected ba^k. "This is your resDonsi- 
bility, and failure to follow t>iis procedure will result in loss 
of pay." ' . . ' 

§ Each "employee^' is expected to come to "work dressed in a way 
appropriate for an interview in his/her field every day . 

• Only one excused absence is allowed with full pay. ' An "employee 
. must call, in him/herself to the supervisor before 9:00 A.M. to 

be excused. More than^'one^ absence or continual tardiness (15 
minutes^ or more) can result in pay loss or termination from the 
program. < 

• Each participant's job is to find a job. Each day participants 
will receive work assignments from their supervisors to help 
them find a job. "Failure to carry out your work assignment # 
will be grounds for termination from the program." 

• Each person is responsible for knowing and abiding by the rules 
of the program. The idea that the participant is^now in a work 
environment is heavily stressed. 

b. Group 'Activities, 

After the introdQctory session the participant is assigned 

2 

to one of two groups^ and begins the classroom exercises in job finding. 



Counselors determined the composition of each group orior to the opening 
*day session to achieve an equal age, race, sex, education mix. 
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Each-of the two group's is led by two' counselors (supervisors). - The 

participant is asked to ke^p three major points^in- mind. 

•t "Davelop and maintain a positive attitude toward this" job ^of 
seeking employment even in the face of possible disappointment 
• • you may experience along the way. Remember that this process 
has worked for many other job seekers and it can work forvyou," 

t "There is absolutely nothing to b§ bashful or timid about In 
your status as a job -seeker. As a matter of fact, you may' find 
that many prospective emoloyers have a positive view about 
hiring young people whom they can tr^in in the operations of 
their individual businesses." 

t "The greatest single source of job leads comes from family- and 
^ friends, so tell everybody that you are presently engaged in an 
extensive, well organized program to find a job. This may .result 
in some very good job leads." 

9 

J Next, the young person engages in various "group dynamic" exercises 
so that he/she mig\it get to know the other "employees" fn the group and 
gain a better understanding of his/her job goals'. FOr example, a mneumonic 
device, the "name game," is played to insure each individual learns the 
other group members' names, followed by discussion of long-term and short- 
range job goals. The time devoted to the latter discussions of job goals 
anil prior work experiences is frequently interspersed with new group 
exercises, since getting young people to concentrate on work- related 
experiences ^or su^ained periods of time is difficult. There are, for 
example, "decision-making"exercises designed to Voster cooperativeness 
and creative problem solving among the group. . In one instance, a 
"deserted i^sldnd" game leads to discussions' on how. people make decisions 
'and the interests that people demonstrate that may be related to future 
job goals.' In sum, the games are "ice breakersJ'Meading' to and from* 
discussions of employment^gbals. / 
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returning frpm lunch,, the participant views a ^vldeotape 0 . 

'oHginally shown on national pub Tic'tel evasion, "flow to Find a Job." 

•'This is a documentary about a. jol) finding club in California similar 

in ways to the Job Factory. In -viewing the film the individual is 

given a clear introduction ^to^the types of activities he/she will be 

involved Avith in the upcoming v/eeks. A discussion follows the film. 

Also, some cycles df the Job Factory invite "role model" guests at 

this point in 'the program to spe^k about their personal backgrounds 

and> successes in the labor market. ^ • ' 

During the remainder of the afternoon the, participant engages 

in "skills search," a formal exercise to determine transferable job 

skills. The counselor explains to the participant that most people 

have skills used daily that can be transferred to jobs.' Youth are aiked 

to settle on particular "job "targets." This objecti^^e proves to be among 

the most difficult for many of the young participants. Counselors return 

♦ 

to it throughout the program? At 4:30 he/she "signs out" for the day. 
c^ The ^Workbook • v 

On the following work day, the individual^ signs in, joins his 
group, ami begins work in a workbook. The workbook structures activities 
for the remainder of the program. It covers seven sections: 

1. Collection and organization of useful background information. 

* « ^ ' • • / 

2» Review of goals, objectives and personal traits. " 

-m ■ . ^ ^ ' ' 

3. Use of information gathered in Steps 1 and 2 to^ create "selling 
tools" (introductory, letters , resumes, references, interviewing 
skills). 



4. JPevelopment of a list of potential employers aitd'-a plan° 
(including schedule) for conmuni eating with them. 
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5. Contact of potential empToyers and other' pebple who may help. 
* Investigation of potential emploj^ers. ' . v • 

7. How to^sell yourself in personal interviews. 

Jhe morning session is devoted to the first half of the participants 
workbooks. In-deptir discussion of individual sections of th^ workbook and 
problems are put forward. -Special emphtsis' is given to indi-vidua,Kcoun- 
sel.ing. ' As the week progre,ssesj the emphasis shifts back and forth 
between the affective, dimension ("you are a salesperson— lei 1 yourself— 
believe in your" product") and the'mdre tangible aspects of job search 
education. Instruction lh resume writing/ for example, frequently takes 
up to two full days. ' "V ' , ' 

The lat*ter part &f the first week is spent on interview skills 
training, including mock interviews in which youth play both the ro>e of . 
employer and employee. These interviews are frequently filmed .on videotape 
and analyzed in enjoyable "instant replays." The participar^i are "drilled 
as to the questions J ikely to be as.Ked in employment interviews and how ^ 
to be ready with positive responses^ ^outh learn how to anticipate unasked 
questiorjj^ and how to interject signals during the interview that hg/she 
will' be a reliable worker. ' ' I ^ V 

d. Actuaf^ob Search • , . ^' 



After the'fi'fst week" (and, sometimes beginning- in the first week^)" 
the bulk of the <partici|)antlSatime is spent in actual search acti vi ties- 
using \he telephone to find job prospects, making fiersonal -^cold calls" on 
> * • — • • J 

-IjRely employers, following up on jobs that were advertised or listed with 
public employmerHi services- Industrial directories,. Yellow Pages; newspaper 



wanted advertisements, street and transportation maps , free'^hoto- 
copying are all provided. In the on-goinq counseling,, considerable 
attention is focused on the "hidden job market" to balance the emphasis 
ox\ formal search strategies. Daily logs are" k'ept of^^sfifeeduled activities. 

^ Participant who do not have scheduledNsjiterviews or planned employer 
visits return^ to the Job Factory at the end of each day to participate , 
in group ^discussions about their experiences of the day.^ 
2. ' -Wilkes-B'arre- Workshop > ^ 
a. " Couns eling , • - ^ > ^ 

There are three treatment groups in Wilkes-Barre. All ' 

.three groups receive career counseling^ Youth are ''counseled on an indir 
vidual basis with sessions scheduled according, to their^indi vTdual needs. 
Typically, youth attend one to two counseling sessions per month of pro- 

^ gram* attendance. Eachr counseling session lasts up to one hour.^^-Most 
counseling is^for youth who are job seekers', although occasionally youth 
who hold job 1| are counseled regarding Qn-the-job problems.^ Usufflly, 
during the first 15 minutes of.th^ counseling interview, youth, are asked 
to describei^ their p^st work- related experiences/ On this basis, the 
counselor^s^s the youtK to make connections between yst jobs and jobs 
that are sought. In tases where youth are undecided abputthfeir interests, 
the counselor spends extra time probing for abilities' and Skills that can 
be utilized^in the workplace. ' ^ . ; ^ • 

A good ej<ampl§ of counseling is^-the case of Anne, 16 years old, who' 
expressed confu$^on over the type of job she would like tOj^ook for».t 'Her . 
initial reqi^est was to find "any job I xan^find." The YB^ counselor 
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probed, and asked her what her favorite leisure activities were. After 
a short dialogue, the counselor found that Anne likes to play with small 
chi*\dren in the neighborhood anc} that she babysits on occasion for 
friends ahd relatives. The counselor then suggested that Anne might 
want to explore working at a day care center or a nursery school. Her • 
first prescribed step would be to contact places that provi3e care for 
small children, and to set up informational interviews to learn "what 
it takes to do the" job." The Ian 15 minutes of the coiA|sel,irig session 
were spent planning future activities, step by step. Anne was asked to 
maintain active communication -with the counselor at^very stage of the 
praeess-.' \^ , \ ' • 

/b. J.ob PJac€ment Service ^ ' ^ * 

Job placement servic^ is the second -pnografa component and is 
provided to Groups I and IT. J6b placemeht service may be defined as a 
method to communicate local job' vacancy information tp program youth. T-he 
youth are shown a "job bank" that ,corvs.i^ts o<*a currenf'list of .local job 
openings for youth. The counselors "interpret the list /or th^'r young 
clients. They match the. needs of employers in the community to tfTe 
intei^ests, experiences and skills expressed by the youth in the counseling 
sessions. Frequently, the counselors get specific requests frj^nsyouth for^ 
jobs where there are no current vacancies. The information -is recorded 
on a filepard and sent to the job developer who circulates the re'quest 
in h>s7h€r routine contacts \$/ith employers. If a specificjob opening 
becomes available, the counselors contact the 'youth to discuss the details. 
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c. Special Job Search, Skills Workshops 

The-^ird YES component is the special job search skills 
workshops received by youth in Groups 2 and 3.^- The workshops teach youth 
practical job hunting skills that should make job search more efficient. 
Content includes how to identify employers,_fill out applications, write 
resumes , and 'conduct job interviews . Through the workshops the youth are 
taught how to deal with Jimited work experience, lack of skills, how to 
listen to employers during job interviews, how to present oneself in job 
interviews—dress and personal appearance, what employers expect during 
job interviews and how to handle stress situations. 

^ The YES workshops are cond^ted in a. classroom style. Young 
people,> for example, are insy^ucted on the proper techniques of completing 
a job application followed by discussion*and examples of "good" and "bad" • 
applications. Toward the end-^of the 60 to 90 minute workshop, tfie youth 
are asked^ use the yellow pages of the phone book and the want ads^iri 
the. news papeV. The youth assemble a Hist of at Jeast40 employers and are 

V . . ' 

encouraged to call for job interviews. Some youth in Groups 2 and 3 att^ 
twD workshops. The second workshop- i^. a review^ession covering the appli- 
cation ,v4n^t;€rvi€Wing skills, resume- prepara^ti on (YES fjpequently restricts 
instruction in resume writing to job- ready youths 18 years or olSfer), and 
the-lis^t of -employers.- . ^/ ' 
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Chapter II 
• • Related Literature 



This chapter summarizes evidence from past experience^ Tn job- 
siearch assistance for disadvantaged youth. The review concentrates^ 
on two principal topics of inti^rest: l)^evidence of JJie employment 
impacts stemming from job search- assistance; and 2) information on th^ 
feasibility of administering job search assistance, programs for low 
income youth. ^ 

A. Evidence on the Emplo.yment Impacts of Job 'Search Training for Youth 
There are virtually no completed studies of programs beyor\d the 
present one that enroll only disadvantaged ycpwth and that have an 
experimental design including a control gfoup to test the impacts of 
•the job search training' program^ However, three clusters of related 
studies give some indication of the effectiven^s of providing youtT 
with job search skills. TIje. first graupT of studies involve expferimepts 
in which, adults and youth N^re mixed in heterogeneous programs of job 
search training. The second group involve proq^ams that enrol] dfsad--. 
vantaged youth exclusively , in job search programs, but where there^are 
ho reliable or available impact data drawn' from control grouos. The 
third group of studies involve job search-education programs for youth 

that are largely embedded within more comprehensive, in-sdhool career 

If • 

development programs. < - i 

^ * * • 

1. Age Mixed JST Programs 

'•» 

Azrin {1975, 1978) appears to be the first researcher to have 
applied the methods of ^behaviorism developed by psychologists (for* 
example, group dynamics, "buddy" systems, peer 'support; pos-itive ■ • 
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reinforc'ements) ;to the Qroblem of job finding among Tow income.clients in 
public employment programs, tn a study of 1000 Work Incentive Progran 
(WIN) clients in five different states, Azrin (1978) compared, the job 
finding rates of persons under 21 years of ^ge who were engaged in 
Job Finding Clubs (along with adults) to youth enrolled in regular WIN 
• ^ services. Although the numbers of youth in the clubs were small (N=46), 
the study found that 48 percent of the job club clients found jobs one 
month af^er* leaving the program, in contrast to 25 pejrcent among youth 
enrolled in routine WIN services. ^ ^ 

A second study, conducted by Shapiro (1978), evaluated the 
- Cambridge, Massachusetts "Job Factory" program for CETA participants. 
This pr&gramj'or CETA-eligible unemployed adult and youth predated the 
special youth-only Job Factory that is the subject of the present study. 
Shapiro's sample included only 18 young persons between the ages of 16 
Sa^^ and 2S for whom there are post-program employment' data. Over half (61 
percent) found jobs within one month after program termination. In 
an internal ^tudy by the Cambridge CETA prime sponsor (1979) of yet another 
• Cambridge program, its Title II-B four-week Job Factory, 46 low income" ' 
^ participants 18-21 years of age were found to have a 76 percent placement- 
. 'rate— a higher rate than for persons of all ages (68 percent) or older 
. , • persons 46 to 60 years of age -(54 percent). Young participants in an abbrev- 
iated version of the Cambridge Job Factory called Job Shop also outperformed 
the entire sample of both young an'B older unemployed persons with an 89 percent 
employment rate (N=28).' 



* #• Other .research studies involving' youth and adults in job search' programs ^ 
/ are reyiewejd.by jBrunl (1981); Marigum (1981); Wepann (1979); a U.S. Department 

of Labor mionograph (1980); and a* study by Olympus Research Corporation (1981). 
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2. Youth-Only Job Search Training Programs. 

A. number of new job search training programs for disadvantJaged youth 

have begun in the past .several-years and their number are rapidly growing. 

These programs collect data on "enter employment", rates; the number of youth 

who entered into employment upon program termination divided by the total 

number of participants eligible for employment. One ne* program jn Palm 

Beach County, Florida involves both CETA and the United States Employmen 

Service. The Palm Be^ch County Job Shop program for young unemploye.d persons 

c 

(16'^to 21 years of a^e) found that its participants obtained an 88 per^cent' 

entered employment rate (DOL, 1980-a). This rate may be compared quite 

favorably to the entered employment rate" of 17 percent for low income^youth 

from the same community* enrolled in the Youth Community Conservation Im- 

provement Program (YCCIP) and 16 percent for youth in the Youth Employment 

and' Training Program (YETP).' - 

Another job, search assistance program is currently operating within 

the offices of the San Francisco ^Employment Service (the Job Track). This 

unstipended youth program is aimed at voluntary "walk-ins" and referrals 

from^Jother agencies. It is very short in duration, only. two days of job 

search trayiing with access l^further job search assistance after the two 

days upon tlemand. The study was. not able to structure an experiment with 

randoip assignment to a control group, .but it was able to select a group of 

comparison youth -from the local Employment Service. Early evidence shows 

« 

^^approximately a 51 percent entered^emp^yment -rate (after six weeks) com- 
pared t^o^'a 42 percent rate among the comparison group of young Employment. 
SerViae clients (Johnson 0981). r ' ^ • 

s. * 

The net effect of the San Francisco program was to produce a job- - 
finding rate pf 55% for the JSA Group, compared to 37% for the comparison, 
group, when adjus^ted for group differences in. demograptuc characteristics. 

" . ■ .42 '" ' " • ■ 





Two other noteworthy findings from the Job Track study are: the ' 
program increases the frequency of direct contact with employers, but; 
wage rates did not differ from those of the' comparison group. Another 
Job Club operates in Lansing, Michigan under CETA Title IV funding for 
disadvantaged, unemployed, out-of-school youth. Modeled on Azrin's pro- J 
gram, the self-reported program data on 99 terminations' in 1979 show a - - 
72 percent entered employment' rate, down from a 79 percent rate in 19fa 
(Capitol , Area 1980).. 

3. Job Search Embedded in Career Development Programs 
By far the most common approach to job search programming is one 
which limits., job search education to a single component in a broader pro- " 
gram df career development. These programs are largely, but not exclusive- 
ly, aim^d at in-school youth and may be found in dozens of school .systems 
across the country, in special collaborative programs between schools and 
CETA, and in the efforts of community-based Organizations. Under the Youth 
Employment and Demonstrations Project Act (YEDPA), several studies are cur- 
rently underway that tejt the effects of providing enriched job search 
education to in-school youth. There is, for example, a comparative study 
involving a Philadelphia high school serving disadvantaged youth .that im- 
parts job search skills and information, on the youth labor market ""(along" 
with career education and work orientation) through a specially designed 
curricalum (USD, 1978). A similar 'study in Delaware {Jobs for Delaware 
Graduates )^ compares the effects of providing high school seniors (only about 
20 percent would be 'Conside^ed^CETA eligible by current income guidelines) 
from a group of high schools with labor market information and job search 
skills (along with career education* and work orientation) and comparing 
them to youth not enrolle^d in the targeted schools ,(bOL, 1980-b). Prelim- 
inary results from the latter study show that 55 percent of the Delawans 

43 



high school participants were working full-time three months afteip^radua- 
tion compared to 37 percent, of youth in a comparison group (unpubliiShed 
POL/OYP data, 1980). However, jfion-partici pants jattended school or training - 
programs in greater numbers than JFO graduates'V Con^dering only those not 
in school or training, about equal rnjmbers in treatment and comparison groups, 
worked full ,or part-time. 

The most significant stiidy to date, with r&spect to carefuT monitor- 
ing of employment outcomes, is the Youth Career Development (VCD) demonstra- 
tion for low income CETA-eligible youth which measures the impact'of six 
separate youth career development approaches in 30 sites across the country. 
Data from the Educational Testing Service (ETS) on 1755- students- enrolled 
in the YCD projects and a non-rjindgm comparison group of 1684 are now avail- 
able (Rock and Freeberg, 1980) • The six separate approaches involve various 
national sponsor delivery agencies forking with affiliated lo1:al operators. 
One YCD sponsor, the U.S. Employment Service, ran a numbe-r of projects which 
concentrated on the provision of labor market information. This latter 

" • • " ] - ' • ■ 

sponsor is of particular interest since its emphasis most closely corresponds 
to the job search training programs under revieW ir/this report. In-school 
CETA eligible youth in the ES/V€b projects were/involved ip an average of 
almost five hours per week of career development activities. The majority 
of time was spent in receiving information /about the youth labor market, 
being taught how to find jobs, and receiving assistance in assessing T:heir 
own personal qualifications and;re^iness for employment. Three month? 
after program completion, the ETST. reported not even a minimal employment im- 
pact--30 percent of the ES/YCj/y^uth were in full-time jobs compaired to 32 
percent of the. comparison* oroup. Finally, across all six sponsors, the YCD 
program is able to- demonstrate only a marginal impact on employment--about 
2 percent more of the Program youth found full-time jobs' three months after 
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program completion than did comparison gpBup*youth (26 percent, 24 percent, 
respectively). It is 'noteworthy that the absenfce of a demonstrable employ- 
ment impact in the ES approach is duplicated in data from the'^YCD sponsor 
with the second greatest emphasis on labor market education--the National 
Urban League. ' - • 

B. Feasibility of Job Search Assistance Programs for Youth 

The job search assistance literature reveals a number of factors • 
which affect the administr^ition of job search ^programs. These factors are 
briefly reviewed below. 

1. Institutional 'Factors 



• In the case of the United. States Employment Service, the nation's 
largest labor market intermediary, self-directed job search assistance models 
must contend with the Wagner-Peyser Act which prevents the Employment Service / 
from receiving financial credit for self-directed^'employment placements*/This 
constraint lies behind Johnson's (1973) account of difficulties implementing 
the San Francisco Adult Opportunity Center within the California Employment 
Service. It has also been noted in the current San Francisco project for 
youth (Johnson, 1980), as well as the Palm Beacfr County Job Shop (DOL, 1980-a) 
fOF disadvantaged youth. 
2. Staffing 

V 

A number of observers not§ that in CETA average job tenure fOr front- 

f 

line job developers and counselors is quite short, perhaps only six months. 
^ The instabili^ty created by this fact touches every aspect of job search assist- 
ance programming for low-income youth. Several studies ^ for example, note 
that counselors are frequently slow or unresponsive to the need to transfer * 
or refer clients to jobsearch assistance programs (cf., DOL, 1980-a;Johnson, 
1980) • Under-enrollment and a lack of sufficient training skills among' 
counselors for the job search approach can be read in these few available 
accounts of job search assistance program implementation. — .v.-^^ 



Progranj rather than the Job Shop (DOL, 1980-a) 



3. Regulations 

Within C€TA agencies there are a number of subgrantees who admin- 
istgr JSA programs. In other instances, job search assistance programs 
are administered by collaborative agreements between sthools, the Employ- 
ment Service, CETA or COTmunity groups. Each of these delivery agencies 
has its own administrative regulations. Consider, for example, the CETA 

r 

requirement^in Florida which dictated that Job Shop youth could only -enroll 
in the program at the beginning of a bi-weekly pay period, or the regulation^ 
requiring graduating seniors to be enrolled in the Summer Youth Employment 

4. Financial Incentives 

CETA programs Sre able to pay the minimum wage to youth who parti- 
cipate in JSA programs ♦ -AJ-a matter of philosophy, many community-based 
programs, and, as a matter of Custom, Jthe U.S^ Em))loyment Service, do not 
ge||erally pay stipends for job search training participation* Not surpris- 
ingly, unstipended approafches tend lo be shorter^ often only l*2^days long, 
than stipended programs, and raise a number of special administrative prob- . 
lems asspciated with their tight,- compact schedulBv For example, in Employ- 
ment Service approaches, the ES is caught- between the self-dir§cted JSA 
approach and the requirement not to deny services to applicants seeking^ 
placement assistance, the lack of financial incentive can also lead to prob- 

Tems of under-enrollment'(cf ♦ , JohTTson, 1980)* * • 

t 

5* Curricula „ ' * . 

The burgeoning job search training'field has- not had time to standard 
ize its .curricula, and as a consequence, is prey to consultants and ^vocates 
proselytizing one approach or another. The Job Track J n San Francisco 
us£S a yolith-specific model, while the Job Factory staff in Cambridge uses 
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.an "industrial m60&^ ""in which clients "punch in'-' and "punch out" in a program 
designed to simulate the discipline of the workplace. Many programs build 
upon Azrin*s (1975) first model in Carb'ondale, Illinois, wijth its psycho- 
logica-1 orientation, "buddy" procedjjrei, peer' and family support. Other 
programs are variants of Hoffman's Self-Directed Placement model (Wegmahn, 
1979) stressing intefviewing skills and 4Jhone calls to .prospective employers 
to "learn from doing." 

If there is a leJson to be learned from the scanty literature, it 
is that very Tittle is known about the effectiveness of one program cgrri- 
culum over another. How much time should be spent, for example, in 
practice res^e writing, simulated job interviews, guidance and counseling, 
group support, "cold calls" and actual job interviews? How necessary are 
fancy videotape recorders and banks of phones? 

Implementation of JSA programs may be affe'cted by the lack of inform- 
ation on effective curricula in two' ways. First, organizations looking for 
guidance and finding none are likely to, try to invent their oWn program model. 
"Ihe "home grown? approach risks ar longey^gestation period before routiniza- 
tion ef operations. Moreover, a number of such programs will be likely to 
fall without benefit of institutional memory. Alternatively, organizations 
looking for JSA models ai^e likely to choose an.existinjg model only to find 
that the model chosen may not be effective in the. new site.* Moreover, there 
are costs associated with the dissemination of program models,- i.e., 
costs usually stemming from the use of for-profit consultant firms. 
The WIN program, for example, has been operating job findili'^lubs since " 
1978, yet only recently has WIN begun the preparation of a technical assist- 
ance guide and formal regulations for operators within the WIN system. 



Before this time, much of the dissemination of job search" asst stance. within v. 
WIN was done by consultants under contract tol the government. Evidently, 
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spread implementation in the field.> 



it takes several years to move from a period of ejcperiment^ion to wide- 



C. Conclusion 

^ • • ' 

Several conclusions can bfe drawn from this literature review, f^irst, 

• there are no reliable data on- the-em^+oyment outcomes to youth enroll6^1 in 
- age mixed job search assistance programs. Azrin's (1978) sample is prom- 
ising, but limited due to the small numbers. The present study. will not be 
able^o flirfiish new data on^ this_topic since both programs under review . 
restrict theit .enrollments to youth. We will, however, be able to present 
findings for different age groups within the 16 'to 21 year old youth population. 

Second^^J^placement rate from youth-only job search assistance 
programs appears to be quite high. Undoubtedly, this is one reason why 
^he programs have proliferated. Although suggestions are <l%de that such - 
programs are a success, the claims cannot be distinguished from the argu- 

raent that youth would have found work anyway, without the gob search pro- 
* * * 

grams. A large number of studies stiggest considerable flows^^f most youth 
•^N^ong work, unemployment, school activity and withdrawal from the labor 
force (cf., Borus, et al., 1980). Many of. the job search studies reviewed 
lack a satisfactory method to compare the entere^l employment rates with those 
that are normal' or expected. /(Researchers generally do not regard the use 
of comparison groups as desirable as random assignment to control groups.) 



The present study "yj^ne si te. (Cambridge) has a randoftily assigned control 
group of youth. Mai^of the preceding problems, therefore, can be avoided. 

• ^ 
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Third, although not strictly job search assistance, iii-school 
programs teaching labor market skills within bfoader career development^ 
programs are not encouraging with, respect to positive employment impacts. 

'Early data from the Delaware project and the employment outcomes from ' 
the Youth Career Development Project are marginal or insignificant 
(Rock and Fre^berg^ 1980). • 

-Fourth, it has been demonstrated that non-stipended job search 
training programs and relatively ^ort programs can operate effectively 
(the San Francisco Job Track), although no .studies have been designed to 
compare carefully th€se approaches to longer, stipended programs. Some ^ 
information on length of participation and the relative 'impon^:ance .of stipends 
wiWjbe prfesented in the present study. ' ' ] ^ 

y Fifth, the evidence' is limited as to what ingredients go into the 
effective adrtiini strati on of job s.earch assistafice programs. One would ' 
expect^that programs with a sufficient history; with reliable sources of 
referrals of youth;. with sufficient institutional support allowing for 
staff training and stability; with cooperation between sponsorijig organiza- 
tions; find, programs that consciously choose -an appropriate job search 

"^assistclnce curricula will operate smoothly, outsidAof normal problems 
inherent in. program implementatio These factors are all suggested by 
the available evidence. No careful completed studies, however, have ^ 
observed the operations of youth job. search training programs. The present 
study examines these factors in the process study of program implementation. 
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Chapter III \ 
A Story of Two Progranis: The Process AnaTysfs 

This chapter presents a process analysis of the administration 
of the Cambridge and Wilkes-Barre job search assistance programs. . These 
subjects are of considerable importance. First, it is important to' know 
whether those managing the programs succeeded in meeting standards of 
perf oTTmapce: " Were disadvantaged youth a.ttracted throuQh outreach to the 
various program treatmervts? -Were youth i/Tthe program the prescribed 
amount of time? How did youth divide their attention and time once in 
the program? Secondly, we need to understand deviations from plans, so 
that the feasibility of job search assistance for disadv^intaged youth can 
be assessed and models of job search assistance can be replicated in 
'different settings. ^ The issue here is to separate the causes of deviations 
from plans into two categories. Are there deviations because the job search 
assistance program concepf is inherently unworkable, or are there deviations 
because of the peculiar operations of the local delivery agents who 
provide JSA? Third, the. process study is necessary to interpret the results 
of ^the Impact analysis/^ The process study serves asTTprelude to the impact 
data becauseiit answers the question--what were the actual treatments? 

3ata for this chapter ''came from several sources. A variety- of 
reports and documents were collected from the two programs, as we,l\^as from 
the funding agencyVuS/DOL, Office of Youth^rograms) to describe the design 
and operation of the programs. The implementation of the programs also was 
followed closely. Numerous field visits were made to Wilkes-Barre and 
Cambridge. A* participant-observer spent every day during each of the five 
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cycles of the- Job Factory. Introduced' to -the. youth as a "supervisor . 
in charge of records," t^e pai^ticipant observer was able to administer r 
to youth many of the tests used in the impact study, survey all counselors 
in structured interviews, keep a diary, and generally observe the program 
from its inception to its exe'cution'.' . ' 

The discussion in t^ils chapter is orgar^ized abound a framework 
which focuses^'on five elements* of proqram implementation. 'The -elements 
selected for this process study include: ^ , ^ - 

(1) Origins of the proqrams— how did the pre-demonstration\ 
environments shape the experiments? \ 

(2) 'StaW-up and Enrollment— early implementation hurdles; 
recrifitment and number of youth served;. 

(3) Participation in treatments; 

(4) . Participants* experience in the program; 

(5) Personnel--composi tion, tr^fning, turnover. 

The chapter begins, by a-brief discussion of conceptual ^mojjpls useful 
in, understanding the implementation of federal programs. The chapter 
concludes by drawing lessons from the process analysis, regarding design, 
replication, and the potential role of process -in explaining the impact ▼ 
of youth job search assistance proqrams. # 
. A. ^ Plans 5nd Action? . * / 

>rV^' There are two models of federal program implementation that 
conditio^p responses to the question'^-"why didn't the program(s) turn , 
out as planne^" One view holds that local implementation is the action - 



phase that follows p.rior planning, .that is, ^ '"carrying through" of 
^policies formulated by central authorities. In^contrast^to this^two- 
stag^, top-down model there is the perspective that implementation ts 
an "iterative" process in :which* persons at^all levels in the planning 
and delivery of 'the programs act, react and mtv^fy original- intentions 
in a "learning by doing" prpcess. These perspectives help clarify gaps 

between plans and^^ubsequent program actions in the two youth job search 

' . ' 1 - ' ^ ^ .V ' ^ 

assistance programs.-. ^ 

. The first moder(t6p=-down) hold| that implementation dtfficulties 

stem from either mis undejjstanding or resistance. Federal authorities, 

for example, may have doae a poor job in communicating their intentions 

or .progranl management may not have been monitored .in a timely- waj^. Jhg 

top-down model suggests that local implementors* may" not have understood 

their role and responsibilities because of poor communication between 

groups. Alternatively, the top-'down modet allows for the idea that the 

local delivery agent understood all that was re'quired, but resisted the 

requirements for any number of reasons. For example, the plans might • 

have been agreed upon as a way to obtain funds and'^p carry on the local 

agenda, paying only lip-service to federal intentions.. Similarly,'Oocal 

groups might find after the fact that thei were philosophically opposed 

to the program concept— "we didn'^t knew we would hate it until we got 

into it.. ."*^ 



Similar perspe-stUes are reviewed in detail in "Views From Below: 
Implementation Researcli in Education" by. Eleanor Farrar, John DeSanctis 
and David Cohen, Huron Institute, Cambridge--an essay prepared for NIE, 
April 1979. The two views' are undoubtedly over-simplifications of the 
many complex actiA^ities that. condition implementation. However, the , 
models are usetul for hinhll^htinq ma.i'or issues. 
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The second model (iterative) suggests a number of alternative 
interpretations. He>?e tiie theme i's not one of communication or resis- 
tance,'but rather improvisation. Gaps between plans and*- actions are 
natural from this perspective, since "the plan" is no more (or less) 

» r 

a privileged blueprint fqr action than, for example, the' intentions, 

goals and interim responses of progr^a op^^ators, participants and local 

officials. Seen from this perspective, gaps between pVogram plans and 

actions are natuj;^ developments in a.process of program survival. 

BothJ:he^^ perspectives ar*e useful in our consideration of the 

implementatioTM)f the two job search programs for youth. Consider, for 

example,, the origm^of the two prog rams 7 as d^cribed below. 

B- Origins of the Job Search Assistance Programs 

2 

4- CaiTfcridge^Job Factory * 

Jlf\e Job .Factory, as defined by the Cambridge Office of Manpower 

Affairs (COMA), is a "short, four week, intensive program combining labor 

market education an^ personal selling skills development .with carefully 

planned and closelj^ supervised job search activities."^ The program was 

conceived in 1976 by Joseph Fischer, then the Director of COf^ and 

Albert Cullen, Director of Motivational Development Associates, Inc., 

consultants to COMA. There were se\^eral versions of the Job Factory tJefore 
the demons t rati 6m for youl^i described in this, report. 

. Much of ^the history of the Job Factory is reported in "Employment and 
Self-Esteem: An Evaluation of -the Cambridge Job .Factory," by Barbara 
' Shapiro. Unpublished ^Ph.D.- thesis (Medford, Ma.) Tufts University; 1978. 

Cant ridge Office of Manpower Affairs, "The Job' Factory— a Job Search 
Education Pj^ogram." Cambridge^' Massachusetts. 1979. 



In 1976, with-a surplus of Title I funds and an unemployment rate 
in Cambridge approaching 12 p^cent, Fischer sought; ways^ to use these 
surplus funds to diminish the high, jobless rate, ajid to s^ve low income 
"persons not benefiting from 'standard CETA programs. 

In a revie^/ of COMA'^ files, both men observed that a large group 

of adult individuals were remaining jobless for lengthy periods of time. 

With no evidence in thk clients* backgrounds to explain their lengthy 

unemployment,. Fischer and Cullen hypothesized that these people w^ere 

failing toisecure work because of poor job seeking methods. As Cullen 
\ ^ * 

stated in/a memo to COMA: 

"'.v. for the majority of people in this group the causes of this 
si\uation are personal and largely superficial. As a group they 
are impeded in their job seeking efforts by some combination of 
.the) fbllowing: 1) lack of knowledge of effective methods of 
fj^ding a j-ob; 2)* lack of communication skills (sic) to present 
"CTieinselves to employers as desirable applicants; 3) lack of 
confidence, drive, realistic job goals and perhaps honest moti- 
vation to apply to an aggressive job search*"^ 

With the preceding as their guide, Cullen and Fischer devised a program 
to address these deficiencies. 

Cul^n, who had previously been Personnel Director of the Norton 
Company (a large, multinational manufacturer) in Worcester, Massachusetts, 
adopted elements of a successful Norton venture that had assisted pro- 
fessional personnel in finding employment to the ne6ds of Cambridge's 
largely blue collar CETA population* Unlike other GETA programs in 
1976, the Job Factory was not designed to p-rovide vocational training ' . 
or job development. Rather it was to be a short, intensive program in 



^ Memorandjjm from Albert- Cullen, Project Director, to Joseph Fischer 
Director of COMA, ''ifre First Job Factory— May-July 1976." September 15, 
1976. • - ^ , 

5t) * 
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which clients would receive* formal instruction in job search skills as a 

« 

supplement,* riither than ^s a substitute for their own efforts to obtain 
jobs-- 

The ch?iracter of the Job Factory was to represeht the real work 
environment* The social reVations between staff and clients were to be 
modeled after the workplace; the supervisor was. to be the "foreman/' the 
client a ''worker," attendance was to be monitored by time cards, "termina- ^ 
tion" was to be equated with firing, stipends. were wages, and so on. In 
other words, the program wal designed so that participants had a job, and' 
that job was to find a job • 

From May through* November 1976, the Job Factory was conducted on ' 
an experimental basis with' various Vdult groups. In^,;prscal year 1977, it 
was introduced into the regular Title I (now Title II-B) service mix and 
made available to Cambridge area CETA clients. Since that time, the program . 
has been replicated by CETA prime sponsors in other states in the nation. 
In each case, the staff from Cambridge provided technic^al assistance to the 
-various organizations. With support from a grant from the Fund for the > 
• Improvement of Post Secondary Education (FIPSE), the Cambridge group, has ^ 
also taught interested counselors^ educators, pi acement^di rectors^ and youth 
program, operators about the program. 

Two variants of the Sdult Job* Factory were also tried in Cambridge. 
A training subcontractor of COMA began a Job^Shop program in 1978. This- - 
was an unstipende^, three^ day job search assistarice program for CETA 
Ti^le II-B clients whose ^assessment and employability development plans 
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indicated a need for j6b search, instruction. This abbreviated program 
was simply the "job market training and interviewing skills" element of 
the larger Job Factory, with follow-up services providing traditional 
employment counseling and job development. Another variation was a 
i^esponse to the- need -for a transition program for adults in CETA Public 
Service Employment (PSE), COMA initiated a two week Job Workshop train- % 
in^ program in which the Job Workshop served as the PSE participants'' 
work assignments for the last two weeks of their enrollment. 

With the experience of the original Job Factory for adult unem- 
ployed persons, as well as two successful variants of the model for specia' 
populations, COMA proposed a demonstration program of job search assistance 
for youth. The proposal was transferred within the US/DOL to the new 
Office oOouth Programs where it was combined with the Wilkes-Barre 
proposal to form a demonstration project. The Cambridge Job Factory for 
Youth (JFFY) was budgeted to serve 300 Youth Employment and Training 
Program (YETP) income eligible youth from Meiy 1, 1979 to October 31, 1979. 

2. The Wilkes-Barre Workshop 

In contrast to the rather Tengthy and complex development of 
\he Cambridge program, the Wilkes-Barre program was essentially a one- 
person creation. >The Youth Employment Service (YES) was created by Joey 
Kelly, a young college graduate, in 1974. She saw the need for an employ- 
ment- related community service after serving as a field agent for Luzerne' 
County in a statewide research project involving a needs assessment of 
services for juveniles. 
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In 1974, Wilkes-Barre had no youth community center where young 




people between 15 and 21 years would be comfortable "dropping in" to 




discuss career goals or Short-teVm employment needs. The local CETA 




office had only recently begun its operations and initially focused 




^ its attention on the- adult population. \ Beginning with a "rent-a-kid" 




program to obtain jobs for young teenagers (12 to 15 years), Kelly 




sought to expand her program to assist older youth in entering the 




labor market. Most importantly, she sought' to develop a motivational^ 




approach that avoided the "coddling" that she attributed to many sti- 


i 


pended federal programs. 

> > 




The Youth Employment Service (YES) was founded with funds from 

/» 




community sources, as wpll as the Pennsylvania agency charged with dis- 




pensing federal Law Enforcement Assistance Agency (LEAA) fund^. It was 




designed to serve in anxl out- of- school youth in a variety of ways: 




t Job placement to help 15-21 year old youth secure part-time 




temporary or volunteer 'jobs; 




t Career and Occupational ^counsel t|nn; 




Job readiness skills workshops, e.g., "how ,to fill out an 




application," "how to interview," "how to write a resume"... 




t Employment search assistance for youth seeking full-time 




employment; ' • 




. t General advocacy. . . 




• 

In J977 K6lly initiated di^scussions with the local CETA.agency 




to secure funds for service delivery under CETA subcontract. The neao- 




tiations broke down when the CETA agency made clear its -intention not 




to expand its youth services throuqR the new community qrolip. Friction 
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between the groups persists today. Partially in response, YES directly^ 
sought funds from federal Officials in the Office of Youth Programs who 
were looking for a site to demonstrate the effectiveness of job search 
assistance for low income youth. YES was invited to submit a proposal 
after extensive federal guidance was providedon a program design that ' 
would be compatible with the burgeoning "knowledge development" agenda 
authorized by YEDPA.- After a period of concept design and redesign, * 
it was decided that a non-stip6nded job search assistance program admin- 
istered by a community <iroup-.in Wilkes-Barre for disadvantaged 16 to 21 
year olds would make a useful comparison to the CETA stipend approach in 
Cambridge. 

3. Implications of the. Origins for JSA Implementation 

The Cambridge Job Factory is in the truest sense a "model," ^ 
having both a record of experimentation and routinization of operations.^ 
The Cambridge operators- of the Job Factory model wel^comed participation 

in the job search demonstration becauSej't allowed them to extend a 

1, . 

standing capacity to deliver a service to greater ndmbers of disadvantaged 

^ * ■ • 

youth. Even without the spec54al demonstration funds under YEDPA, COMA^ 

may have begun to enroll more youth in CETA Title II-6';jbb'^arch programs 

The Job Factory's origins^ then, point to a model of implementation. that ^ 

is "iterative." The design was a natural outgrowth of prior program 

experience and the federal government's role was limited to that of . ^ 

financial support. 

* 

■60 ' ' . ■■, • 



In contrast, the origins of the Workshop proaram in Wilkes-Barre 
suggest a "top-down" approach. to implementation. The founding director 
originally establ'ished an open door, youth-servinq agency Ifhat offered 
employment preparation services to youth from all incomes in the community 
who "dropped" by the program. The funding for the YEDPA demonstration 
placed three new. requirements on YES. First, a program was designed by . 
federal authorities around three principal services' to enable research 
into the various aspects of .lob searcl^^ education. Although YES had 
always provided these services, the three qroup design imposed a new 
formality^^o their rather casual, pre-demonstration service mix. More- 
over, the design required th^ organization to cooperate with an outside 
research agency;, this had J:he effect of diminishing the program's insularity 

Secgnd, YES had to meet federal income guidelines" for economically 
disadvantaged youth, a difficult task for"^ community group that had ^ 
served all referrals and walk- in youth. Third, YES had to comply with- 
a number' of federaVrules regarding program and financial records. Again, 
-the local program did not have procedures orgajiizetf to meet these require- 
ments before the YiDPA demonstration. In many respect^ then, the Workshop's 
origin foretells a stpry of "top-down" implementation. 
C. Start-up and Enrollment ^' " • . 

1. Wilkes-Barre - Workshop , ^- 

Three weeks after its federal contract -was- signed, the Workshop 
enrolled its first participant. This minor delay would not be cause for 
notice if all* §iibsequent enrollments were' on track. However, as Table- 3-1 
illustrates, the rate of new enrol lees each month was below planned levels. 



The IB month contract called for 750 participants or an average of 

.41.6 youth oer month. In the first year, the program enrolled . 274 youth 

* » 

or 56 percent of planned er^llment. Each month the Workshop underen- 
rolled, realching only 32 to 88 percent J)f planned enrollments. Over the 
full contract period of 18 months, t)i€ Workshop enrolled 401 youth or 
53 percent of the planned 750. There are several explanations for the 

s 

underenrollment. ^ . 

Much of the early underenro*l]ment problem can be traced to ^ 
collection of income verification forms. Our interviews and observations 
indicate that the Wilkes-Barre program was unaccustomed to thisliew 

requirement. Before the demonstration project, YES -served a mixed 

» 

income population and was not required to employ income verification 
procedures. , - > 

A second explanation for the underenrollment- relates to methods 
of recruitment. YES records the referral source for qach of its parti- 
cipants. Over half of the participants (54 percent) are walk-ins, com- 
pare(j to 29 percent referred from hiqh schools, and 16 percent referred 
from social- service agencies. Clearly, the origins of YES'as^a- "drop-in" 
center persisted through the demonstration phase. 

•Program records maintained by' YES indicate that one out of three 
youth contacted through outreach (high schools and social service agencies) 
ultimately enrolled in the Workshop (184 t 5ip). Similarly of the walk-ins 
to the YES p^rogramT^e in three {Z\l t 606) enrolled i.n the Workshop. 
What happened to the remaining two thirds of the recruited youth? First, 
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only 59 percent returned the income forms (1116 contacts - 659 -returns = 
457 no returns). From the dooI of completed forms, 62 percent were found 
eligiblej)y .CETA income standards (659 - 409 = 251 ineligible). In sum, 
of the total recruitment pool (N = 1116),. 41 percent did not return income 
forms ajid 23 percent were not income eligible. This 64 percent loss from 
the original recru.itment pool signals the "difficulty the program had .in 
both reaching .and verifying income eligible youth. Put differently, the 
large recruitment pool contained many youth who were inappropriate for 
the, new job anarch program. We suspect also that the recruitment- effort 
failed to target low income unemployed 'youngsters. 

At firstrplance, the recruitment effort for the Workshop appears 
adequate. .Outreach began in May- 1979 when two staff members visited a 
total- of nine high ^chqols in the area." Counselors , also attended an 
annual Youth Job Opportunity Fair in the commurii ty where an information 
t)qoth was set up to advertise YES and the Workshop Program. Press re- 
leases i^i local newspape'rs and radio announcements were also used as a 
means to attract potential participants to the program. The initial re-, 
cruitment effort was expected to yield a starting pool of 10(J youth. 
By the end of May, only 46 youth were enrolled in the program. 

The recruitment of a- large group of youth in the summer proved , 
to be more difficult than was expected. Some high school graduates 
wajited to "take it easy'.' before enrolling in a formal job search program. 
Other youth had already made plans for the summer months. Also, the _ 
Workshop, witti .its special DOL funding, was now in competition with the . 
local CETA agency with its year-round and sunmer youth Employment programs. 
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Table 3-1 \- 

Enrollments; *^ 

Wilkes-Barre •■ 





Actual 


% of Plan ' 


^ 


Actual ,. 


% of Plan 


May- June 1979 


55 




Jan. 1980 ^ 


' 13 


~ 32^ 


July 


34 


83 


February 


19 ' 


46 ' 


August • 


26 ' 


63 


<*• 

March * • 


16' ' 


39 • 


September 


14 


34 


April 


16 


" 39 . 


October 


36 


88 „ 


Sub- total. 


274 


56 


November , - 


27. ' 

• 


66*^ 


• hfay-Oct.h, 


80 127 


' 52 


Decent) er 


18 


; 44 


Workshop \Total 401 


. j53 




> 






> 


0 



■ ) 



■ * 



Actual V PI anne(V Monthly Constant {N=41) 
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Unlike the Workshop, the CETA program in Wflkes-Barre offered to pay 
participants the minimum wage dwring enrollment in its programs. 
^ The* YES program had a difficuljt time competing with this CETA incentive. 

Finally;, we can speculate that YES may, have exaggerated the numbe 
of youth it could serve in its funding proposal. It underestimated the 
difficulty in finding qualified youth^to enroll, in part, because \,ttie 
top-dcwn implementation had placed YES more in the role of respondent 
than initiator of prograhi elements. 

2. Cambridge Job Factory 

The Job Factory program was divided into five cycles and as 
a consequence, there are five separate start-ups and enrollments to 
consider. Also, the research design called for different target groups 
in each cycle. The first and last cycles were aimed at graduating CETA- 
eligible high school seniors. The design called for the last cycl^to 
be unstipended: Cycles 2-4 were aimed, at unemployed, out- of- school 
youth— some of whom were .to be high school graduates and the others 
^school leavers. Rather than consider all Canfcrjdfle cycles together, we 
firs-t examine cycles ^and 5 for graduating! seniors and then the middle 
cycles for out-of-school", unemployed yoUnr/ ' 

One month after the effective', date of the demonstration', COMA 
befan its first Job Factory cycle for graduating seniors. Table 3-2 
shows the number of youth recruited, found eligible, the reasons for 
'ineligibility and enrollments as a percent of plan'. The f1rst*Uob 
Factory program enrolled 44 low 1ncome\youth, just 12 percent short of 
the plan. ' ' ■ . . 
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Table 3-2 




• 


* • 




Cambridge Job Factory 








Recruitment and Enrollment 




J ^ 




' Cycle 1 
June 1- 
July22,1979 


Cycle 2 ^Cycle 3 
'Oct.T2- Jan. 25- 
Nov.9,1979 Feb. 2,1980 


Cycle 4 
Apr. 4- 
May 2,1980' 


Cycle 5^. . 
June 5- ^ 
, July 25, 1^80^ 




CGraduatfng (Unemployed {Same as 1) 
Seniors} YouthrBoth 

HS Grad. & 

Dropouts) 


(Same as 2) 

- 


(Grad.Senlors 


1) Number recruited ^ 




130- 


120 


■ 120 


89 


2) Percent applica- 
tions complete & 
eligible 


• 

• 


81% 


63% 


•58% 


29%. 


3) Percent applica-: 
tions ineligible 


47% ■ 




36% 


42% 


71% 


4) Reasons for in- 
eligibility in ' 
Cycle 2-4 as^a ^ 
pejscent bf ineli- 
gible applications 
(a) not returning 
income state- 
^ ment 




■ 

28% 


39% 


* 

17% 


NT 


(b) ineligible be- 
cause in prior 
Job Factory- qr 
control group 


\ 


20% 

t 


15% 


33%' 




(c) found employment 
before day 1 of 

(d) above income 


progrp 


12% 
'20% 


34% ° 






(6) pother/ unknown 




20% 


12% 


50% 




'5) N in Exp. (Day 1) • 
* 


44 


.56 


38 


36 


26 ' 


.(a) « HS Gr^dua^es 




40%.. 


34% ^ 


42% 




(b) % propouts 




59% ■ 


66% 


^57% • 




6) N in control 


35- ■ 


35 


38' 


34 


Not' ass1gjj[ed 


7) PI anned^ Parti ci- 
' pant Enrollment 
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50 


50 


50 
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Table 3^2 (Continued) 



•8) Did finrol.lment of 
dropouts reach 50 
percent. 

^ Percent of Plao"- 
(L1ne 5 * 7* 



Yes 



88% 



Yes 



112% 



Yes 



72% 



26% 



^OTE ; Average enrollment was 66 percent of plan: cycles 1 and 5, 47 percent nf plan; - 
cycles 2-4, 87 percent of plan. • ' ' » 

^ Enrollment data from researcher's 'intake/exit form, (IPPy^ecruitment data-from program 
records and cycle progress reports to Department of La^r. 



^oripMg with the Cambridge School Department and the Cambridge Youth 

Resource ^Bureau, a recruitment prog rafm was initiated through two fully ^ 

staffed ^utreach stations located at two Cambridge high schools. The re- - 

crui'tment cam|iaign includefl: ' * - • , 

0 Three separate letters (with program brochures) sent, to homes ^ 

of graduating seniors; • , . 

* s 

^ 0 Newspaper stories in Cambridge and Boston newspapers;. 

0 Special contacts with all local social agencies who had communj- 

• cations with low income families; \ _ * 

0 Contacts wftK Cambridge private schools whose student bod\e^ 
included low income youth; . 

0 Staff presentations at Cambridge Rindge Latin High School ;'^ 
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0 Posters throughout high school' buildings, housing projects, 

teen recreational, and "hang-out" locations. Poste'rs^ prdlnoted ^ 
the financial incentive through slpgans\ . ."Take our money, 
please. .V $520 to find a job/.."" - ' ^ - I ^ 

0 Staff presentations to &eniar civics classes^. .Presentation at% 
a final "Senior Assembly" cff^the academic year*, 

o _Jw)nt page i^ews story in ttie final edition of a stud&nt newspaper 

for academic year; . - ' * ^ . 

' ' 0' An offer 9f ^a $2.00 "bonus" to all seniors who' complete the 

application prpcess. . ^ * 

j^^j/en^"* the most aggressi'^e recruitment campaigns, however, frequently 
. xonfnont unanticipated circumstances. First, the School Department grossly 
^overestimated the number of grStduating seniors wht) were income eligible for 
.Cycle 1. " It is conceivable t^at they misunderstood income eligibility 
standards fqr.CETA programs in'^p.art because their involvemenjt in l^pcfSl CETA • 
-Ipnograqis had been limited in the past. Second, COMA counselors discovered in the fi 

^ - ' • , . ■ - ^ ^<s ' :-r-y \ ' - " 
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cycle campaipn that they wer§ in competition with one, other CETA pro-* 
gram, .the Summer Youth -Employment Program. They reported that the 
youths' primary questions about the tv;o procirams were concerned with 
paynidnt. "What day do -we get paid?" "Do we get paid for Tunch hours?" • 
"If I get a job early.'do I get paid^throughout the rest of the program?" 
Youth rarely made s choice on the basis of program content. Furthermore, 
our observations reveal that a number of youth ■ -never chose one ' 
program over another.^ They entered the Job Factory program in June 1979 
while awaiting selection for SYEP in July. Interviews with 'counselors/ 
'suggest that the reason for this was the program's "hard sell" recruit- 
ment effort with its "Take ourmoney, please" slogan. Many counselors . 
had Jhixed emoti&ns over the use of bonus payments and stipends to get ..* 
youth enrolled. In any case,°the mixing of job search assistance and the' 
Slimmer "program has -obvious implications for ,the analysis' of post-program 
oatcojnes in Chapter IV. Third, a number of qualified applicants made 
clear to our observers that they planned to enter educational institutions 
tn the 'fall. , To them, the recruitment stipulation "looking for full time, 
'permanent employment" did 'not constitute a, barrier to participation. In 
fact, COMA knew, of their educational%lan$ and did not^deny participation 
for that reason/ . • ' 

Cycle 5 was-eTlso to^serve graduating senio^sy but the original design 
called for the program not to offer stipends.. Experience with recruitment 

in Cycle 5 illustrates fhe importance of CETA minimum wage incentives and- 

' *. ^ 

the difficulty ..operators^ have' in functioning without this "carrot." 



The recruitment tactics^. utilized for Cycle's were'»as' vigorous 

as those employed in Cycle I; however, the results of recruitment were 

poor*. At the close of the initial recruitment period, 10 complete and 

14 incomplete appl-i Cations had been received.. A poll taken of the few 

senior year applicants found that half. had heard of the Job Factory v 

Most were in school as juniors the prior year and. had friends or relatives 

who had participated in th? program.^ ATI of those familiar with the 

program knew that*youth had been paid -to participate in the past. As 

noted, previously, past recruitment campaigns had stress^ed this 'element. 

Clearly, the unstipended phase of the Cycles program was a failure. 

Cycle 5 began with only 3 clients on June 5, 1 980.^ On. the second day, 

2 of the 3 young people left the program. The third remained in'contact 

with Job Factory staff until he foujjd a full-time job. The COMA progress- 

report for th^it xycle (dated May 1980) states, "it was our hope to keep 

the recruitment period open through June'4, 1980 to get as close to 100 

applicants for e)y)erimental. ^roup status as possible"* and places the , 

blame for uhder-enrollment to the fact that, '-lall those familiar with 

the program kne'w that 'everj^one else had been paid to»do it {. '.<>. Take 

Our Money,. PI ease) even though this cycle was "sold" as a unique 'new ^ " 

service..." Following the unstipended experiment, COMA ran* a stipended 

cydle "phase". which is reported in Table3.2r The latter was implemented 

rapidly witfiout significant implementation hurdles, much like the earlier 

Cycle I. . ' ^ 



Analysis of the recruitment associated with Cycles 2-4 for 
unemployed high school graduates and drop-^outs shows that the operators 
used thi^echniqi^^of Cycles 1 and 5 with the exception. of substituting 
Hs.ts of names from' high -schools for names submitted by community agencies 
serving low-income youth. Implefnentation of the programs proceeded 
.e\4*nly and without special events. 

Three informal palls were conducted of applicants in Cycles 2-4 
-t-o*^eteHfiine the most common referral source to the program. Unlike 
Wilkes-Barre,^here oveAhalf the recruitment pool are "walk-ins," the / 
Job Factory youth responded to individual letters of invitation and 
acquaintance with previous \ppogram participants. 
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D. Participation in Treatments ^ 

The Job Factory program in Cambridge is a fou/ week program that, 
by design, succeeds when youth find work and leave the program. As 
noted previously, the first week of the program is the most structured 
phase, followed by job search, feedback, and review of systematic job 
search skills. Positive terminations- in^the first week of the program 
were not uncommon. In contrast^ the Workshop in Wilkes-Barre did not 
enroll youths for full^days of treatment. Rather, youth came in for 
half-days, after school or in the evenings to receive counseling, job 
placement services; or to participate in the job search skills workshops, 
depending on their assignments to Groups 1-3. The only structured group 
activity was the workshop. These were scheduled when a number of youth 
\x\ Groups 2-3 could be brought together^ usually in the evenings. Because 



of the individualized approach in Wilkes-Barre, and a rolling enrollment 
policy, YES arbitrarily fixed active participation to three months post- 
application (or less, if youth terminated' positively by accepting employment)^ 



\ 1. ' The Cambridge Job factory 

a. Attendance Pro<^dui4s , ' 

Attendance was monitored quite closely in Cambridge as a matter 
of policy. One reason, of course, was to determine how many hours youth 

should be paid for participating in the Job Factory. A 4etailec^ moni^op'ng 

system drawing on daily attendance records, logs of activity, and a com- 

puter system tied to the prime sponsor were used for this purpose. When 
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attendance problems were noted, individual letters were sent to parti- 
cipants* hollies. On several occasions; mini Job Factory sessions^ were 
scheduled for youth who missed parts of the Job Factory due to flu epi- 
demies or other reasons. The make-up sessions had strong requirements 
for attendance and punctuality. Youth were told that .the special sessions 
were ap alternative to termination. Finally, communications with youth 
who were in the process of withdrawing from the program or going ^'inactive" 
were. recorded in short memoranda and discussed fully *by the Job Factory 
sta/f . ^ • ^ ^ . 

^b'. Hours of Participation : / : ■ 

Table 3- 3 shows that the mean hours per participant spent in 
each cycle average 83. The fewest hours were spent in Cycle, 3, followed 
by Cycle 4. Tfie two cycles s.erving high schd"b1 graduates. enroll youth 
for -nearly the same length of time, 87 to 89 hours. ^ In each cycle, excep*^ 



Cycle 3, oyer iia_l-f--af-t4ie participants stayed in the program two weeks— long 

enough to participate in the first week's structured activities and a second 

week of actual 'job search. In Cycle 3 most youth (63 percent) were in-the * 

program over 60 hours. 

We explored a number of participant characteristics; sex, age, race, 

family status, economic status and educational background, to determine 

whether any were>6lated significantly to hours of- participation'. -Also, 

f 

two separate ratings by counselors of the youth--^e, a general assessment 
of 'the yOung job se.eker and the other an assessment of relevant' ejiiployment 
_^barriers (described fully in Appendix D)--were examined in terms of hours 



Thke data on^hours^of participation were retorded by the researchers and . 
program staff on an exit form (IPP). The data are validated by the fo Mowing 
estimation procedure: the Job Factory paid $59,343 in allowances ($3.10 per^ 
hour) to 200 youth. On an 8 hour per day basis, the average participant spent 
95 hours in the Job Factory, or 12 days. However, we know^ that many youth who 
found jobs in the^ first weeks of each cycle received a bonus payment'equal to 
two days of participation. If we assume that 50 percent of all particioants 
received the bonus this would mean that, on the average, the typical 
program ^participant spent approximately 11 days in the prog^am--83 hours. 
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■ Table 3 -'3 

* 

Cambridge Job Factory Participation- In Hours 



In Percents 



• ^sVe I 



Cycle 2 



Cycle 3 



Cycle 4 



^ Cycle 



, flours' 




.1-8 


^5.3 


9-25 


7.9 


26-42 


•5.2 


43-59 


7.8 


60-76 


15.6 


77-93 


10.6 


94-110 


2.6 


111-127. 


18.3 


^128-144 v ^ 


13.0 


14^-161 


13.1 


162-169 




. Mean Hours^ ° 


8D.7 


Number 


38 







2.1 
4.2 
12.7 
.8.5 
14.7 
12.8 
19.1 
10.6 
6. '4 
4.2 
"4.2 
85.7 
47 



8.7 
lp.6 
17.2 
2.9 ' 
17.3 
11.6 
'8.7 
5.8 
8.7 
-5.8 
2.9 
70.4 
35 



3^1 

3.1 
9.3 
1*5.6 
18.7 
12.4 
18.7 
9.3 
3.1 
,|.l 
3.1 
80.2 
'32 



86.7 
26 



Source: The Individual Participant Profile. Entries verified by participant- 
observer. 
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of participation. In Canbridge, no significant statistical relatfonships 
were identified except for one. Forty seven percent of this youth identified 
by counselors as having a medical or psychological health barrier to 
"getting or keeping a job" were'in the propram a long time (94-169 hours) 
and fewer (only 3 percent) were in a short time. (1-25 hours). It is not 
a surprising finding that youth identified by staff as having a health- 
related employn^e^ barrier were^ in the program longier than those without 
such a barrier. Appendix D will consider whether significant 

relationships exist between such employment barriers and obtaining jobs, 
2. Tni Wilkes-Barre Workshop , • ' 

In Wilke$-Barre, the program operators found that providing 
adequate treatments to all eligible youth was thfe most difficult aspect 
of implementation. The scheduling of individual counseling sessions was 
not a difficult chore. However, the group activity, job search skills ^ ^ 
workshops were difficult to schedule. When workshops v^re scheduled, 
they frequentlj' served fewer youth at a time (usuallj^ 2-3) than originally 
planned, and in many instances, workshops were not given at all. The 
third service, the job bank placement service, was not effectively 
delivered to many youth, - 

'J 

, a. Job Cbunseling 

Table 3-4 below summarizes much of the data on the number of 
treatments received by Wilkes-Barre youth in ihe Workshop, Counseling 
services were delivered to a Inactive y^th. On the average, there, were 
nearV six sessions per participant.. The' numbers in Table 3-4' show that 
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Table 3-4 
Workshop Service Mix 



I Number 

II Job Career Counsel tng 

a) Average Number of 
Sessions 

b) Percent' Receiving 
Sessions 1 

« 2-4 

5-7 ' 
8-11 . 
12-16 
12t18 



j Group 1 



138 



5.2* 

Percent 

01 
47 
36 
10 
05 



Group 2 



140 



6.8 

Percent 

03 
21 

^ 39 
■26 

WW 

11 ^ 



Group 3 



123. 



5.7 

Percent 

* 08 • 
38 

31 , 
10' 

13 



Total 
401 * 



5. St 

Percent 

04 * 
36 • 
35 , 

15 

Iff 



III Placement Skills Workshops" 
Percent • 

No. workshops 
1 workshop 
' 2 workshops 

3 workshops 

4 workshops *" - 
average number of workshops 

IV Interviews Through Job 
PTiicement Service * 

. Perc j^it 
,No .interviews 
1 interview ■ 
' 2 interviews 4 
3 interviews 
4-5 interviews 
6-7 intey^vtews 
8 interviews 
12 interviews " 

average number of interviews 



. Not Assigned 



21%. 

S3% 

27 

09 

07 

02 

01 

01 

1.9 



39% 
^% 
13 
02 

1.2 



30% 

55^ 

32 

06 

03 

04 



1.8 



39% 

^% 

25 

04 

-05 

1.5 



Not Assigned 



39% 
7F% 
18 
03 
02 
1.3 



26% 

56% 

29 

07 

05 

02 

1 
1.9 



(Con'tinuf? Table' 3-4 on next paae) 
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V 



V. 

Percent Spending .Hours: 

11-20 

21-30 

31-40 

41-50 

51-60 
,.61-70 

71-80 
--81-90 . 

91-100 
101- IW 
111-120 . 
121-130 
130-180 



Mean^Hours^ 
IJumber 
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Table 3-4 Cont'd 



Group 1 



69.7 
5.7 
0.8 



0.8 
3.2 
8.1 
4.0 
4.8 
0.8 

. 0.8 
0.8f 

26 .j)^ 
12f ^ ' 



Group 2 



Group • 3 



62.1 
9.0 
0.8 



3.8 
0.8 
4.7 
4.6 
3.1 
4.7 
2.4 
4.0 

35.0 

132 



59.1 
8.8 
0.9 



'2.3 
6.2 
5.2 
9.4 
2.7 
1.7 
2.7 

0.9 
31.3 
li5 



Data 'provided by program operator to researchers, ^nd reported in program "progress 
reports. . . • , 

** * - . ^ ■■ • 

Hours of participation recorded on Individual Participant Profile (IPP). 



a few youth received 12 or more sessions in each treatment group; but 
overall, most youth received' tyetween two and seven sessions. Although 
there was random assignment to each treatment* grouD, the number of 
counseling sessions per participant can be compared across groups to 
get a rough picture of where the most cotri^eling took place. On that 
basis. Group 2 and then Group 3 show the, highest concentration of youth ^ 
receiving career counseling. Our interviews with counselors in Wilkes- 
Barre suggest that counselors felt unanimously^ that the individual 
counseling was the most helpful aspect of" the program, 
b. Job Search Workshops 

The program feature in the Workshop that was most closely 
tied to job search assistance was the "job search skills workshops" in 
res uijie writing, search procedures, and intervi'lsw skills. The workshops 
were not given to 39 percent of all eligible youth. Our interviews 
suggest that^the YES operators had considerable difficulty in attracting 
youth back to the program for this group activity. The principal reasons 
were related -to scheduling. Many youth were not motivates to return after 
school for workshop sessions.- Evenings were seen as "free time," and some 
youth complained .that the cost of bus transportation or parking outweighed 
participation. Several counselors told our interviewers that the lack of 
financial incentive contributed significantly to the failure of youth to 
participate in the workshops. Among youth who ^id return fof the job search 
skills workshops, three quarters took 'Ouly one workshop— 18 percent par- 
ticipated in two works hops--wh^Je^ few youth took three or four, workshops • 
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t. Job Placement Services 
There is no direct evidence on the number of youth who /ere given 



the job placement. Oi>r interviews suggest that this featui/e was fre- 
quently /tied^o the couffl^ling sessions and job search sk/lls workshops 
Program repords provide thV number of interviews that.youth obtained? 
who received job' placement. The research desigji-did n/t permit this 
service to be offered to youth assignei! to Group 3. \However, one in 
four youth in tfie other groups did not obtain even 6ne interview as 
part of the job placement service. Over-tialf of ifhe interviewed youth 
(56 percent) got only one interview, while 29 j/rcent 'got at least two 
interviews. 

We- can only speculaj;e-Wliether the job information in the job bank 
is us.eful or ouf^of^ate for' the^ youfig job seeker. The YES program reports ' 
that throjighout their contract period, they contacted 425 prospective 
employers ; ^80 respojide'd with job orders (66 percent)— a quite decent job 
development effort. The problem is that the Wilkes-Barr^rogram does 

* • ♦ — 

little to supervife the actual job search process/ The prograiti^s highly 
individualized approach makes follow-up and supervision of job search 
effort difficult. Moreover,, our interviews with youth and counselors 
indicate tha't the placement (jtob bank) feature of the program was parti- 
cularly diffuse, and essentially organized by the youths themselves. For (; 
example; YES reports that only 51 youth took advantage of the ^80 job -f^? 
orders received through YES job development*. Expressed as a,- p'ercentage of 

:h in Groups 1 and 2 who went out for • interviews, the' 51 job orders 
i1led means that 25 percent of all youth interviewing can be attributed 
to program job development; 75^ percent of the interviewing was with employers 
found by the youths themselves* 

/ 1> . i 
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Tine in Program 
Based on the preceding information on the service mix in the 
Workshop, tTie amount of direct service time^spent hy youth ii«i the 
Workshop program can, be estimated. As noted previously, an estimate 
,is necessary because the Workshop does not accurately record acftiye ^ 
service time for participants^. Rather, the program considers youth 
"active" for up to three months after program exit; "exit" is.xlefined - 
on a ease by case -basis by tjtfe operators. On the average-, each coun- 
seling sessio'n is equal to an hour of progranutime. Another hour should 
be added for thre time associated with obtaining one job interview from 
the gob placement service, finally, the typical Workshop participant ^ 
took one 90 minute workshop. On the ayerag^, then, a youjh assigned 
to 5roup "2' spent approximately 9^ hours in the program (seven hburs-^of "^"^^ 
counseling plus one hoy^r interview plus Ih hours In workshops). The 
typical youth in Group 3 spent approximately 7h hours in direct service 
time. Youtho'n Group '1 participated in about six' hours of the program. 

Time spent in the prdgram is'available on an exit form^by the 

f * 

program operator (as noj^ed earlier, definitions employed varied, on a 
client by client basis)'. The records for 369 youth correspond closely 
to the latter estimates upon close examination (.s'fee Table' 3-4). Although 
the means of hours spent in the program were high (in Group 1 it was 
26 hours. Group?, 35 hours, and in firoup 3 ,31 hours), the medians are low. 
The reason is that the distributions of hours" spent in each group were 
extremely skewed. Between 60 to 70 percent of each group spent only one 



so 



to ten hours in the program. Another 8 percent spent between 11 and 
20 hours in the Wilkes-Barre program. There is some evidfence that the 
operator did not directly service the rejnaining 30 percent of youth 
for the^ indicated hours in Table 3-4 arid that in many instances time 
spent exclusively on research questionnaires or administration was 
Counted as program hours. In anyca'Se, our conclusion is th*t in 

, Wilkes-Barre the tinle. spent in^ the program-% participants was quite 
limitpd. -Typically, it adds up to one and one half days of service 
time Finally, we examined data to determine whether hours of partici- 
pation varied by background characteristics of participants (e.g., sex, 
race, family status, economic status,. and educational background) or _ 
with the counselor ratings and assessments of employment barriers.' The • 

^only significant* relationship (by chi. squares with significant tests) was-^ 
found for high school graduates. More high* school graduates were in the 
program longer than non-high, scJffo^^^ 

^ Ct Participants' Experiences in the Programs 

In {his. se'ction, data are presented showing the young participants' 
e^lLftitions of the t^o job search assistance programs. The responses come 
from a survey administered when youth left the programs (the Program 
Comp 1 eti on. purvey )'. 

Table 3-5>hows the most frequently mentioned job.,search assistance 
services i^ Cambridge in terms of the participants* assessments of whether 
they l.earned ^ flrfeat deal,^ liked the services very much, and found thF 
services very -helpful . From the participants' perspectives, skills that 



teach how to prepare a resume are seen as the most valuable *aTid enjoyable 
form of job search assistance. Mock intervie\^4)ractice^ppear^s second 
on the list of helpful aspects of job search training. It was also an 
enjoyable experience for many of'tfje young job seekers. Contacting 5ind 
arranging interviews with potential employers as well as personal job- • 
related counseling round out the list of activities that the young' persons 
found enjoyable^ Jielpful^ and educational. Somewhat lower on the lists 
were group, discussions? Finally, personal counseling about non-work themes 
is placed low on the -GJifTt) ridge lists because this element*is not a formal^ 
or important aspect of the Cambridge service mix. 

Tn Wilkes-Barre, theTankings corresporfti closely to our previous 
descriptions of the Workshop program^. The Workshop was primarily ?dn 
individual employment counseling program, although counseling about 
"general things in life" also played an important role \x\ terms of what 

youth enjoyed and found helpful • Beyj^nd^counsel ing, youth indicated a 

'J ' " 

preference for actuaj interview and job contact elements. In_sharp 

contrast to Cairfcridge, a tangible skill, "such as resume writing, was 

Oast pn^the Wilke^parre list,. Group aetivi ties^. were rated moderate to 

low i'Ti value by the Pennsylvania, youth. These data round out the picture 

of the Wilkes-Barre community program as a '^"drop-in" Counseling type of 

program, rather than a' narrowly focused' job search training program. 

- Finally, we asked a number of questions tjhat probed general 

feelings about the proqrams.. Overall, the vast majority of youth in both 

programs indicated that they pot along well with the staff and other ' ■ 

youngsters. Only a few youth in both programs indicated '•that they.*^is- 

liked the job search programs. 



Table 3-5 



^ RANK ORDER OF CAMBRIDGE JOB FAOJORY SERVICE MIX 
I By Number dt Youth Who Indicate Each) 



Service 



I Resume Writing 



Contacting Potential Employfers ,^ 

Jnterylew with ^Potential Employers 

Mock Interviews, . « 

Personal JbbnRel'ated Counseling , 

GrouD discussion of the : 
"WoVl.d-of-Work'' ^ ' 

&roup review of past-work • ' 
txperlencffe^" \ . 
* 

Personal Counsel i fig about General. 
Things in life 



Learned a 
Great Dea l 

U) 
. (2) 
(3) 
(4) 
"(5) 



(6) 



(7) 
(8K 



Most 
Helpful 



(1) 
(3) 

\ "(5) 
\(2) 



\ 



V 



|4) 

\ 

ik 



(6) * ■ 
(7) 



Liked Very 
Much . 

(4) 
(5)' 
(3) 

,(2) - 
(8) . 



(6) 



(7) 



, Table S-5B 
RAMK ORDER OF WIlj^ES-BARRE WORKSHOP SERVICE MIX 

(By 'Number of Youtb Who ^ndi cater Each) 



Service^ " 



Learned a 
"Great. Pisal 



MDst 
Helpft^l 



Liked Very 
Much 



Resume Writing « ' v . ■ " iB) 

Contacting poten^tlaT emptoy.ers ^ (2): 
♦ • - ^ » '* 

Interviews wlth.poten^JaV. employers (3) 
Mocjc Interviews ' , ^\ ' (4)^ 

Personal Job-Related^ Counseling (1)"^ 



> Group dlsctfssloft^of the 
••world-of-worfe 



Group review of past-work 
ex|>er1ence$ 

Personal Counseling about General, 
Things in Hfe ' , 



*'(.5) 



(7). 
(4i. 



(8) 
(4) 

(1) 

(6)' 

(5y 

{2) 



(8) . 

(.3*) 
(4L 

(5),. 

(6) 
(2) 
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f. Personnel ' . . 



I.. j3ob Factory - Cantri<lge 

The executive 11 eadership in the Cambridtie protg^am was quite 
sophisticated by CETA standards. The oriqinal director of ,COMA was a • 

* 6 
0 4 1 

former director of the National Alliance of Businessmen and had exten- 
S/ive experience in^ administration and personnel in the ^private sector. 
His. collaborator in founding the Job Facto ry^was a private manpower con-* 
sultant with considerable .experience as .the personnel director for^a 
large manufacturer. Together they strengthened- prior Jjnkages in the 
community with social service agencies, business, and schools during the 
operation of the Job Factory. . ' - 

' The effective utilization of personal networks to make the local • 
organizational infrastructure work, to link persons and organizations *; 
'together, helps to a^unt for the relatively srpooth implementation of 
the Job Factory program. For example,' in the-^fir^t cycle, the consultant 
served as acting program coordinator; twb staff members were borrowed from 
the Cambridge Economic Opportunity Committee (CEOC), a COMA- CETA sub- 
contractor to servers coiinselors; an associate of the consultant was 
hired as a counselor; and, the director of COMA reassigned a CETA staffr 
person to serve as a counselor. ^ ' ' 

.The COMA director was a persuasive executive. .He motivated, for 
example, the counselors in the first'cycles by /f)romis3ng that* they would 
eventually participate in consultations to export the Job Factory model 
througho.ut the C^TA system. Counselors* expectations of future financial 



rewards were not always met and eventuallyAcontributed to morale' 
problems. In the short run, however, thjs strategy proved quite 
effective. The COm/tfl rector also paid littl\ attention to the ^y- 
to-day "front-line"" aspects of the program. - H^as able to successfully 
delegate this' authority to the bob Factory m||ag^. In addition, he 
was able to retain the skills of the private consulN^nt Who sferved' as 
^ "fixer," a person who makes repairs and adjustmentsVto keep a program 

^on track, troubleshoot, see. to the details of curriculu^n development, - 
assign counselors, and the like. In sum, the ,CETA directV fi.ts the. 
description of a "mover," who was able to delegate and get the Job 
Factory off the ground. Eventually, he moved himself out of h^s job 
to a new challenge in* Wasfrington, D.C. / A** 

Support staff can play a very important role in-impleijentaVion. 
As noted previously, the counselors in the first cycle pf -the Job \ 
Factory were, on loan from CEOC. , There is some evidence that they' were 
not enth"usiastic about participating in the JSA program. They did not\ 
volunteer for the new assignment ^nd resented somewhat their new COMA 
supervisors. Our interviews with them reveal that two counselors pre- 
f erred working* with adults and' felt that "the youth Job Fiictcrry m*odel 
was "chaotic" and less effective than other training programs for youth. 
After tf\e fifst cycle, the staff was Tet go and a permanent Job Factory 
manager with prior experien'ce in CETA operations,- private'Htidustry employ 

•ment-ari'd adult Job Factory programs was hired. The manager, with the 
dOMA director ai>d the -private coniiultant, hired several full-time ■ 
counselors- ■ - 



The new Job Factory manager and staff coFnprised a diversity of- 

background and talent.; The' manager was a minority female. Among the 

^•five person staff, one couns.elor was Hispanic and'^notljer was a black 

male with over ten years* experience -in personnel, mostly in the, private 

^sector. A tf\ird Counselor had two years of experience as an employment 

counselor. -.A fourth counselor was fluent in Spanish, yet had limited 

^ experience as a CETA couiiselor. The f'vfth counselor , was a female with 

two years experience as' a counselor/planner at a youth advocacy center. 

This staff ^as generally more knowledgeable "of the*- objectives of job 

' search assistance than the Cycle 1 personnel, and expressed to our 
' ' ' / ^ .V ^ - 

interviewers considerably more satisfaction with their jobs. 

2. The Wilkes-Barre Workshop ^ ' / . 

The or/i'gins of the Workshop, described previously, demonstrate 

^ that the .program was entirely the Creative product of one^person^s effort. 

. Unfortunately, the ex^utive had difficulty fn translating that creativity 

into a stable ^program. She. encountered serious difficulties in the per- ^ 

sonnel area. ' Under considerable- time pressurae, three full-time counselors 

were hired ^r. the demonstration, while a research coordinator w§s ' 

"borrowed" from the regular YES -emijilxDymeni program. Tv/o of the counselors 

were recent graduates of Wilkes Co.llege. One h^ a graduate^egree in 

.education and psychology. None had ^pecif inexperience in job search 

/ ^ " ' . : . ' • ' ' 

/ assistance^or group work with teenagers. All "Were expected to workMn 

the new demonstration as well as regular YES activities fqr above income- 

eligible youths ' ' 



In the first year of program operation, the Workshop experienced 
considerable personnel turnover. Most significantly, the founding »• 
directqr of YES left Wilkes-Barre tn March 1980 to work for the Department 
of Labor. In Cairbridge, there was "a sophisticated staff who was able to 
respond to the departure of the executive. In Wilkes-Barre, th.e depar- 
ture of the Workshop director marked the beginning of an unrafve.ling of 
the organization. • ^ 

o 

The YES founding director was replaced by the assistant director 

who ha?l worked at YES for twp years. Now serving as feting director, 

he was severely limited in his abi-lity to operate the agency. Tor several 

reasons. First, he had to. defer to instructions from his employer (now 

In Washington) even though her ability to keep up-.to-date was«severely 

limited by di.stan.ce. Second, the YES board of trustee^ began to fill 

the void of leadership, exerting n'tself where it hadn't before, and"^' 

forming factions ffver program- goals and personnel issues. Some board 

mentis were loyal to- the actifig director, while others'were loyal to ^ 

the founcj^. Unable to make key personnel decisions and gener^al agencj^ 

policy, the acting director lost face, with staff and outside agencies 

who wondered who Wjas running tfie prograrrt^ Morale ^among counselors 

suffered duetto the growing confusion over lines of communication and 

» * 
authority. The moral e^probleiji was exacerbated by frequent staff turnover. 

• •' the original, staff in May 1979 was . the Executive Director, 

Assistant Director, three counselors and one research coordinator. * - 



Four months into the proqram, the research. coordinator was fired. 
.A counselor became the interim part-time research coordinator but 

resigned sever) months into the' program. Another counselor- became 
^acting research coordinator part-time, and counselor the rest of her 

tinie, until January 1980 when she became full-time coordinator. Three 

new persons were hired in December-January 19a0; a part-time research 

coordinator; a new counselor; and a new "ob developer for the agency. 
'The job developer was soon fired and the new counselor took her place, 

after sharing the responsibility for a short time with the two other 

counselors^. 

In sum, counselors in charge of-program operations were switched 
back, and forth to administrative positions-, creating confusion and ^ • 
instability thr*ouahout the program.. Moreover, 'interviews with the 
staff show that they universally -preferred ^direct service time to admin- 
istrative details^ related to the demonstration- Finally, the growing, 
gap between the Executive and counselor salaries was a. source of dissatis 
faction recorded in our interviews .■ • Toward the' end of the contract 
period, the founding directlTr made ^'arrangements -to return to the program 
andii^the acting director left the agency. As of the writing of tms . i 
study,- the Workshop must answer a number of questions and conditions 
from its federal f.under .regarding future support. 
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Conclusion 

The two job search assistance programs were, conce'ived, developed^ 
and shaped by entirely different circumstances.' The Cambridge Job Fafctory 
used federal funds to modify an existing program model that in the pre- 
demonstration phase had undergone considerable experimentation and 
- r^efinement. The demon! tration funding did not create special constraints 
on the spdnsor organization, partially because the latter was the sourci? 
for the demonstration program design. In contrast^ the origins of the_ 
Wi Ikes-Ba rre Workshop illustrate a "top-down" model of implementation in 
which federal requirements, ranging from program design to recordkeeping, 
were followed with considerable .difficulty.- Almost overnight, the Work- 
shop was required to switch froFji an "open-door" youth-serving community 
agency to a formal employment program for di sadvimtaged youth. Not ^- 
surprising^y,. the program was changed substantially from the time it was ' 
initially prbposejl. Once initiated, the Wor-ks^hop did not rlin ^smoothly.. 
The process studly identified the followihg. difficulties in the Workshop's 
implementation: r , ' . 

§ underenrollment by nearly half the j^roposed number-^-^ youth 

served • ' ^ 

\- , " ' . 

t difficulty in income verification ; 

recruitment' mefhods abased on an -over-reliance* on "walk-ins** 

: • recruitment difficulties traced to the fact that YES* did not 
offer stipends for pari:icipation \ , , 

• the failure to deliver all planned sej-vices to the appropriate 
participants--39 percent. of assi gned ybuth did not. receive job 
search skill workshops while 25 percent of as'signecl ydiith did 
not participate in one job interview as part of the ^ob placement 
service » . - 

. / ^ , 

t total, direct service^ time was extremely limited and typically .* 
'was less thai^lt) hours ^ ^/ • . " 
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• personnel experienced frequent turnover and di.sruptive 
rfiassignments; the organization lacked .effective executive 
leader-shtp during much of the demonstration 

• young par-tici pants generally enjoyed and rated as helpful those 
aspects of the^Workshop progY-am that were stressexljn the service 

'.mix, such as counseling.and actual pob ^eart:h; however, tangible / 
elements of job search training, juch as resume writing pre- x 
par-ation, were not^erijoyed or viafued'by the'Wilkes-Barre yj9uth ^. 

• The Cambr-idge Job Factor-y oper-ated more smoothly than the Wilkes-Barre ' 

pr-ogr-|m, -but itr was. not^ without rmplemeatation difficulties. In particular-,^ 

th^' pVocess study reveals that: x 

• Cycles that were designed to serve low income gr-Sduating 
senior-s were the*most difficult to implement. Local school 
systejns over-estimated the univer;5e of need; other pr-ograms 

' oper-ated in the summer months, that wer-e attr-actiye^ al ter-natives 
to the job sear-ch pr-ogr-ams; many s^llfer-s disguised their 
intentions to r-eturn to school and wer-e only tempor-ar-ily 
unemployed'. . ^ 

• fhe importance of stipends for job search par-ticipation was 
dr-amatically r-evealed by tKe failure of the Cambridge progr-am 

[ to-oper-fiLte an unstipended cycle of the Job Fac*tor-y. Recr-uitment 

impMved r-c^i^dly once the* decision to pay par-ticipants the- 
minimum wage for "working" in the Job Factory was r-esumed. 

• In^ontr-ast tckthe cycles for gr-ftduating senior-s, cycles that' 
wer-e' designed tio ser*ve youth most in need— unempl oyed youth, . 

, both high" schoo> gr*aduates an^drop-outs-^-eachfed 87 p6r-cent 
' of planned enr- ollments and actually over-erir-olled- the tar-geted 
number- of dr-op-out-S. ' « 

r Much of th^ effective' implementation of the Job Factory cycles 
can be lr:aced to thfe executive leader-ship of the sponsor-ing 
or-ganization; to the utilization^ of a private consultant to 
.get .the ear-ly progr-am initiated;' to effective ties with ' 
community resour-ces; and, to a stable and iiiotiyated staff. ^ 

The pr-eceding difficiil ties in Wilkes-lBar-r-e ar-e by no means unique 

to job sear-ch assistance pr-ogr-ams. In ^ct-, a. rather positffve conclusion 

is that many of the documented diffi.cul tie's in "the Wor-kshop ar-e not 

easily traced to the job sear-ch assistance concept. Most of VMl'kes.-Bar-re s 

problems. wer-e due to the suddenness and newness assocfated with par-ticipation.. 



in a national, demonstration. Also, many of the Workshop' s_ problems wer|p ' 
,to l?e expected ^ince any new program, job search or otherwise, will 
likely face major; start-up difficulties/ Unfortunately, in^ the^se of 
Wilkes-B a rrev our evidence was collected during the progra^ first- year of 
operation' of a formal job' search assistance 'program for ^0H income youth. 
Therefore, caution must be exercised iir intepreting the resutts of the 
impacts in the next chapter since the Wilkes-Barre program was clearly not 
yet- operating efficiently. ' It is. unfortunate that most experimental 
programs must be evaluated during this uncertain -phase of development. 

The Cambridge progMm is a useful comparison since its operators had 
considerable experience in- dealing with the federal government, researchers 
and prior programs of >ipb search assistance. The implementation of the 
Cambridge program yields more insights for the replication of job search 
assistance than in Wilkes-Bc}rre. The process siory regarding s^-vices 
for graduating seniors; unstipended approaches 'versus stipends; attracting 
drop-outs to job search assistance; the ability 9f job search programs to 
' impr.-0!Vftv^nd learn over time; and the importance of leadersbifi and- trained- 
staff are all topics of considerable importance to planners intent on 
expanding j^b search assistance programs to disadvantaged youth. Whether 
the programs actually work in terms of a number of outcomesMs the^ topic 
considered in' the next chapter. . , - ^ , 



- Chapter IV 
The* Impact Analysis 

V 

The pyrpos? of this, chapter is to evaluate' the impacts of job 
search assistance programs (JSA) in the^ainbridga ^nd Ijlilkes-Barrje sites 
on the job seeking "behavior ofyouth. Considering possible short-run, 
impacts, 'the first question is whether— $he--pnjgrams matle a difference in 
the rate of job finding. - Successful job fiiiding, however, is sufficiently 
^ pervasive,- "even among youth, that a more pointed cjuestion is'whet'her the 
program speeded up the process of findipg a job. Now suppose that a 
program '*does .succeed in getting youth into jobs more quicl(1y. This may ' 
be ..a favorable outcome, 'l)ut to be sure, vye must examine the quality^ of 
the jobs f<ound\ Jhe quick results may come because. youth are' prematurely 
pushe^d into warse jobs, but, alternatively, tffe JSA may have -a double benefit 
oV. not only helping youth find .job^^uickly, but also helping them to 
finti^i)etter jobs. jfWe shall examine' several dimensions of quality, such as 
wage rate, hours worked, earnings, and tHe rate of leaving the job. . 

' Given the shortness «Sf our period af observation, we cannot test 
directly whether these prog(*ams have effects that will persist on a long-^ 
run basis (over one yean)./ However, we^ can /'•ob tain ifidirect information f 
\)y examining the jfiechanfsms by which JSA^Jffe.cts job search behavior. Knowing 



For«,sevt-dence On the pajtterns^ of 'job finding among youth over time, see' 
Borus, Michael et al., "Pathways to the Future: A Longitudinal Study 
of Young Americans—Preliminary Report," Center for Human Resource Research . 
Ohio State University. January 1980. . ^ 
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how JSA works can also be useful in designing "the structure fdr a JSA-^ 
propram-. One possible chanfiel of effect is that JSA may transform the 
.work-related attitudes of youth in "a way that makes them more effective 
in finding (and oerhaps, also in' keeping) ,iob.s. If attitudes- are b^e- "* 
fic'ia'lly chanaed, an ^fect from the-oropram is likely to persist beyond 
the initial .spell of unenmloymenl;. We shall use ifieasures of attitudes 
and .knowTedge areas devAped by the Educational Testing Service (ETS). 
(These are -described .i/ SeV:tion C and Appendix E.)- V 

nel -of effect isthat the JSA may teach youth valuable 
v' ■ ' • . 

skills related to job. finding (and berhaps job holding). -If so, these 
skills are also likely "to survive, producing benefits from the orog rani that 



persist into the future.. While we do not^ have good measures of search \ 
skills; we can look at the job finding technigues actually -used by.. vouth- to . 
see if the program makes any difference in. these. ' " . 

0«e additional channel df ieffect is that th'e JSA ma.v induce or 

a- • * ' . * * 

pressure youth to- search more intensively. These three channels are by no 
m'eans mutually exclusive.' .They could even reinforce each other, if, for 
examole, improved attitudes led to \more intensive search. However, tt is* 
conceivable that' increased intensity is the,o'nTy channel of effect. ,It is 
the channel least Tikely to produce lasting effects (beyond the experience' 
*that comes from searchiria for and holding .iobs which is attributable only 
Indirectly to the prooram). It may be that the effects of this channel ^ 
alone are sufflci'ently impressive, .that one would wiinfto consider how to 
structure the JSA to provide the pfealiest jndtic6ment to youth *to , Increase 
the intensify of th'eir search. * * . . ' " 
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The first section of this chapter will introduce the experimenter!' desi'gn! 
The second will present our results on job finding rates and job quality. The . . 
next two sections will consider channels of effect, with Section C concent rat- ' 
ing on attitudes and Section D on. search techniques and the intensity of search. 
Section E will present- the- costs of the prQgrams while Section F will* sum- 
marize what we have learned about their benefits., Background information on 
the youth in our samples and on labor market characteristics of'Caml^ri^ge 
and Wilkes-Barrs may be^ound in Appendix A and B. Appendix E describes the 
timing of research sljrveys. Appendix F contains numerous tables, of interest 
tliat jire supplementaVtb'the major .effects ^described iti tb4-s c^ha^pter, — , 
A. Experimental Design - . ' ^ ^ 

• - The study was able to^tructure an experimental design with random 

assignm&nt among applicants to .experiment and control grou_gs In.four ou^*p_f 

five cycles* of the Cambridge program (with procedures to assure equivalent 
distribution by ageV sex, and^ethnicity). All youth^were CETA eligible. The 
first cycle served graduating seniors in. the last days of their senior year; 
Cycles 2-4 Served unemployed yQuth, some with and others without hijgfh school' 
diplomat. Cycle 5 served graduating seniors again. - ^ 

As noted in the previbus chapters, the WUkes-Barre design did not 
allow for. a control group (n -non-treatment youth. Instead, the researchers 
randomly assigned participants upon program^entrance to one of thcee treatment 
groups. Ea.ch groqp was designetl to represent a different level of directed' 
job .search. ^ Group^*l received job career counseling -and job plapement services' 
(a type of job bank listing). * Group 2* received job career counsel ing^ job 
placement services and special job search' ski 7?ls workshops^ trcJup* 3 received" ^ 
job career "counseling, and the special workshops. PaVticipants in Group 3 . 
were, however; enoQuraged to *-incl /ob's on. tffeir own', since they 'did not. receive 
the job-^listihgs in the 4)lacement service component. . These components are 
summarized schematically in Table 4-1. * • • 
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Table 4-1 

Components of Wilkes-Barre Treatments 

^ Wilkes-Barre Experimental Design 
(Random Assignment) 



Individual Job/ Career 
Counseling 

JDb Search Skills 
Workshops 

Job Pl'acenent Service 



Group 1 



-Yes 



No- 
Yes 



Group 2 
Yes " 

Yes 

Yes. 



Group 3 

'Yes 

. .Yes 
No 



ft* ^ 



J'r 



4^ 
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" 3' Results on Job Finding . » , ♦ • . 

This section pnpsertts. our results on the extent. and timing of 

" - ' \ ' il - ' ^ 

job findinq and on the characteristics of job^ found* 

Job Finding Rate ' ^ , , - , 

^ ■ The job finding rate^is the proporiion of people jn^ samplelwho 

find jobs during some interval of time.' The^'yirst purpose of this section 

is to -test whether JSA'treatrfients make a diffferen^ in.^the extent of job 

finding". We sKall examine 'whether job fin^dinp- rates differ, between l3roups 

rec^iving• different *(or no) JSA treatments "over comparable time intervals. 

Second, the section ♦/ill examine-whet^her JSA Itreatmentslrfeduced the^ttme *c 

, • ta^ken to find .a job.'^'^r study of timing is facilitated by our use of ^. . 

maltiole pos,t-program follow-up Interviews with person^. Jhus fof*' any trea 

control group,' we can measure^^lhe .30b findina rate- ffdm- the -time of enroVl 

ment to tHe first follow-up arid again to the tinife of each of the -succeeding 

^ fdllow-uDs. (We always use theVlime of enrcllTment .as, the thinning of these^' 

Y ' • V ^ i' ^ ^ 1 • • 

'inj:,erya3sr) By comparing, rat^ across treatmervt groups -for successively, t 

' , longer time int6rvafs, we caft learo about,|he tlrr^ng o'f treatment ^fect. , -v^ 

- ^^^'^ . , Table 4-2^presehts tfefe;4qb fiRding^rat^s as of 't^e time 8i"ead^ « * 




* ^ folTfnv-up'iirtj^rview. For'^Camb^ldgV thfe rates ""are presented separately ** ' y 

• • -v^^-^ ' ' ^^^^^ , 

a /or ,eft€h7d}4c}0, and within'^^ycles fCPr extftri mental and contcol gf^otbs^-^ 

* t , .^i^ • . * ^ ' * " « • • • . - * 

^ "for Wilkes-Bar¥e, the ^ates are pfesented. separately for e?ch fre^tment*>_ , 
.grouD. The r^te as. of 'the first follow-up measures the^pm)ortion "who ; 
found jobs between the beginning of the,jiroqram -and the first -post- jarogram 
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intervfew: The r^ite at the second follow-up measures job findtha from the 
stmie beginning point,^but up to th^ second foljow-up.. The differe»^'*in 



Table 4-2 



Jot Finding Rates . ' 
'(Expressed as percents, with, sample sizes given in parentheses) 



Cambridge 





* 

Ave. No. of 
Weeks Aft^r 
Fnrol Iment 


"Cycle I 
May 29- 
June 22 


Cycle II 
Oct 12-. 
, 1979 Nov 9,1979 


Cycle III 
Jan '25- . 
Feb 22,1.980 


Cycle IV 
' Apr 4- 
May ^""1980 


Cycle ' 
June- 5- 
July 28,1980 


All Cycles 
Combined 


All Followrups 
Complete 


Rate? at- 
* 1st fOl- 
Tow-up ■ 


• 

% * 

•v ' i» 
4 


Exp 

62.9 

(35) 


Cont 
40.0 
(30) 


Exp cont 
61.0 ^4.4 
(41) (27'). 


E)?p 

74.1 - 
(27'). 


Cont 
6D.0 

,(■20) 


txp 

70.0 

(TO). 


uont 
55.6 
(9> 


Exp ' 
'50. 0 • • 

\ 1 


bxp Uont 
63.6 '47.7 
(125) (86); 


LXR 

56.1 
• (41) 

■/ • 


■ Lonx 
. 36.7 
(30) • 


■Rate at 
2nd fol- 
low-up- 




75.8^ 
(-33) 


71.4 

(28) 


71.9. 6\).0 
(32) (15) 


§8.9 
(18).. 


92.. 3 
(13) 

/ 




f 


f 


• 77.1 73.2 
(83) (56) 


68.3 
(41) 


73.3 
(30) 


Rate at 
3rd fol- 
I'ow-up 


37.5 

*> 


80. 6~ 
(31). • 


8a. 0 

.(25) 


77.8 75.0 
(27) (16) 








% 

• / 


t 


79.3 78.0 
(58) (41 i 


75.6 
(41) 


'76.7 

(30) 


Rate at 
^4tli fal- 
'. low-up ' 


45.4. 


83i3 
(30) 


84.2 ' 
(19) 


73.9 ,.78."*6 
(23) (14) 


s. 










79.2 .'81.8 
(53), (33) 


78.0 
(41 ), 


80.0 • 

.(30). . 



/ 



'(Cbntinued on next page.T 
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Tatle 4-2 (Continued) 
Job Finding Rates ' 
(Expressed as percents, with sample sizes given in parentheses) 



Wi]kes-Barre 



/^ate from 
-^CI 

Rate at 
1st fol- 
low-up 

Rate at 
2nd fol- 
'1 ow-up 

Rate at • 
3rd fol- 
low-up . 
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Ave. No. of 

Weeks After 
Enrol Iment 


Group I 


Group II 


Group I^I 


.All • 
Sroups 
Combined 


Group I 


All Follow-ups 
Complete 
Group .11 


Group III' 


9.4 


70.7 
(58) 


70.8 
(72) 


• 70.8 . 
(65) 






• 


\ 


24.1 


77.4 
(53) 


68.9 
(61) 

• 


76.0 

"(50) 


73.8 
(164) 


80.8 
(26) 


.60.9 

(•23) 


73/7 
(19) 


^38.7 


- 89.5 - 
(38) ^ 


90.2. 
(41) ■ 


84.2 

(38) , 


88.0 
(117) 


88.5 
(26) 


82.6 
(23) 


.78.9 
(19) 


47.9 


92.3 
, (26) 


' 83.3 . 
(24) 


* 

89.5 
(19) 


> 88.4 
(69) 


"92.3 

(26) 


'87.0 
(23) 


89.5. 
(19) 




\ 






/ ^ ' » 


i 
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job'fl|inding rates between the second and first follow-ups thus measures 

tlie proportion ^ho found jobs between the first and second follow-ups ^ 

and similarly for successive follow-ups. 

Considering now the results for Cambridge, 'the job finding rate 
as of the first follow-up was substantially higher for the Experimental 
group than for the Control group. This was true for each cycle (except 
Cycle 5 where there was no control group), with the differences between 
^ Experimehtal and Control groups ranging, from 'la high of .229 for -Cycle 1 
to a low of .141 in Cycle 3, all sizeable. That is, between 14 and 23 
percent more of the sample found jobs by the time of the first follow-up 
if they participated in the Expenimental 'tre^tmer;t. Over all cycles, the 
difference in rates was .159. ^ ' ^ 

In contrast to the large effect of the Experimental treatment up. 
to the first follow-up, the differenop in job finding rates is mugh smaller 
for subsequent follow-t»ps. Job finding rates rise for both the Experimental 
and Contrql groups as one moves down each column to successive follow-ups, 
but there is a bigger-spurt in job finding in the Control group after the 
first follow-up so that the Experiment-Control difference diminishes. For 
those cycles having fourth follow-ups, the cumulative job. finding record of 
the Control group 'is actually slightly better^than that of the Experimental 
group. ' i 

There is a possible problem in these numbers in that therfe was sub- 
stantial attrition in our sample beyond the first 'follow-up. (see Appendix E, 
Table A-9). Thus, it is conceivable that the change between the first and. 
fourth follow-ups could reflect differences in attrition patterns rather^than 
changes in job finding' experiences. To examine this possii)ili ty , we restrict 



attention to those who completed all four follow-ups, and present their 

job finding rates in the last colup of Table 4-2 (aggregated Across cycles 

because the sample si2e is now small). The pattern in jqfe finding' rates is 

still similar even though" there is no attrition Withiri this subsample. In 

particular, there is a big 'difference in the job finding rate up' to the 

first follow-up, but. the difference diminishes subsequently, becoming 
ft. 

-^negligible by the time of the fourth fo>low-up. ' ^ ^ 

Table 4-3 presents the number finding their, fvrst' post-enrollment . 
""job between successive follow-ups for^Cambridge* .Since vjriatiops in sample 
size by fqllow-up could distort .these results, attention is restricted just 
to those whQ completed all followiups. ^ This* table^shows more clearly the ^ 
different in timing between experimental and control groups. A majority of 
those in the experimental groups^ound jobs by th3 time of^the first follow- 
up -{roughly 11 weeks after enrolling) In comparison to only a little more 
than^a third for the control .group. For the control group, job finding-is 
spread fairly evenly up to the' second follow-up (roughly 15 weeks later), - 
while for the experimental group it is -concentrated more heavily before the 
first. In both cases,, however, close to 70 percent of the samples find jobs 
by the t\m of the -second follow-up^ with only a trickle of first 

jobs later. Thus,, the va^ .majority of job finding for both groups takes 
place within 27 weeks, but there is relatively greater conqentniation of job 
finding among those in the experimental* group within the first 11 weeks. In 
this sense, the JSA speeded up job finding. 

Another insight Into the process of job finding is obtained by look- 
ing at .the employment-population (E/P) ratio at each follpw-up. The E/P 
ratio provides ^^ewhat different'information.than the job finding rate - 
since it depends both on job finding and on job* leaving. Table 4-4 presents 



Table 4-3 

» 

NuiTiber Finding First Post-Enrollment Job 
between Successive Follow-ups, Cambridge^ 



Experimental 



Control 



Enrol li^ent to First Follow-up ' • 


Numrer 
23 . 


Percent 
56.1 


<< 

Number-. , 
\ ■ 

11 


Percent 
36.7 


Between First ahd Second Follow-up 


5 


12."^ 


11 


36.7 


Between Second and Third Follow-up 


3 


7.3 \ 


1 


3.3 


Between Third and Fourth' 


1 


2.4 




3.3 


Never Found Job * 


9 


- 22.0 . • 


6 


20.0 


Total 


- 41 


100.0 


30 


100.0 



Derived from final column of Table 4-2, 
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• .Table '4-i ' 
Employment-Popylation Ratios, Cambridge 



1st Follow-up 
2nd Follow-up 
3rd Follow-up 
4th FoVfow'-up 



> All Responders 
Experimental Control 
63.1 47'. 7 

55.1 55.1 
56.4 51 .'4 

64.7 50.0 



Responders onfall 4 Follow-ups 
Experimental Control 
56.1 ^ 



.51.2 
48^.8 
61.0 



36.7 
46.7 
40.0 
43.3 
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E/P ratios for Cambridge, first for all responders on each follow-up and 
second restricted to those who completed all four follow-ups. *The E/P 
ratio IS nearly identical with the job- finding, rate as of the first follow-up. 



However, it diver^ges increasingly for successive follow-ups. For the fourth 
,foHow-up it is considerably larger for the experimental group than for the 
control group, a sharp contrast to the lease "^f the job finding rate which 
was nearly identical for both groups. The discrepancy at the fourth follow- 
up could be explained either; by a greater rate of job leaving in the control 
group or by a pattern of attrition where ea'rlV job finders are lost more 
frequently from the control group than from the experimental group. ^ The re- 
sults in-Table 4-4 for those responding on all four follow-ups suggest^ that 
for this ^ubsample involving no attritfon, the discrepancy does remain. For 
thts* subgroup apparently there must be gr^eater job leaving among control 
grbup* members. 

Job* leaving an^J. sample attrition patterns for Cambridge are examined 
more explicitly' in Tafcje 4-5. The table cdnpares job finding experience as 
K)1F the first foil oW-up with subsequent- employment experience. \Qonsider those , 
who had found a job .by the fi rst. fallow-up (section 2 of the taBle).^ The ' — 
table does show .that about twice as many in the experimental grotiR, are 
known to have reta'lned their job over all follow-ups as in the jcontrol group 
(line 2a). There is indeed, greater sample attrition nn the control 'group 
among these early job^ fijiders (line 2b). .In addition, the rate of job leaving 
does appear higher for the control group (line 2c). The E/P ratio tells a more 
complex story t+ian the job finding rate, but the data in Table. 4-5 stf&gest. 
tfiat the two stories can be reconciled. 

Taken at face value, these re§ults suggest that the experimental treat- 

s ^ 

ment has a large short-term effect (within ten weeks of entering the program), 



* . Table 4-5 

Job Status •at the First Follow-up Related , 
to Subsequent Job Experience for Cambridge 



Job Status at * - ' ^ Experimental Control 
1st Follow-up . Subsequent Job Experience- Group ' Group 



1 ; Did not find job 


(Total number) ^' u . 


48 


. 45 


la* Found job on some subsequent 
follow-up, as percent of.l. 


33.3 


' .40.0 




lb. Uever found job (complete in- 
'fonnation) as percent of 1 • - 


18.8 


' 13.3 




. fc- No evidence that found job^ but. 
information incomplete as per- 
cent of 1 . . . 


47.9 


46.7 
t 


Z. Found job 


(Total number) 


82 


41 




2a. Never left job* (complete in- 
formation), as percent of 2. 


• 19r.5 


9.3 




2b. No evidence that left job, but 
Information incomplete, as per- 
cent of 2. 
- • 


<• 

59.8 


63.4 




2c. Left joLon some subsequent 
follow-up, as percent of 2. 


* 20.7 


. 24.3- 
■ \ 



TT ' 
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but the control group does cakh up Soon afterwards. Apparently, the 

experimental treatment does get many youth to work quickly. Tho^ in /w 

the Contr'ol group are just as likely to 'find jobs eventually, but the 

process -of finding theiii is a slower one.. Given the nature of the program, 

this is ^lot a surprising res'ult. It needs further verification and elabor- 

ation, but first consider the' job finding rates in Wilkes-Barre which appear 

in the bottom of Table 4-2. . " ' j 

In Wilkes-Barre there is no Control group. but there are three dif- 

ferent treatment groups which can be compared. The follow-up .surveys were 

administered later in Wilkes-Barre than in Cambridge., However, th& timing of 

the Program Cpmpleti on Instrument in Wj Ikes-Baf-re was similar to that of 

•the first follow-up in Cambridge. The first /Dw for Wilkes-Barre- (Table 4-2) shows 

the job finding rates obtained from the Program 'Completion Instr1*Bi|nt. 

Notice .that the rates are virtually identical across Experimental groups. 

'Moving now to the rates from the follow-ups, the differences^across groups 

are small, but there is somewhat of a pattern^ Group '1 generally has' the 

.highest job finding rates, while Group' 2 has the lowest (with'the exception o^ 

the second follow-up). This is surprising since Group -2 receives^ a m*oret 

intensive treatment,, but we'have not yet tested whether the difference is , 

•significant. In the last three columns the sample is restricted just to _ 

.those who completed all follow-ups. For this sample, the difference 'between 

groups becomes very small by the last foJlow-up, with all rates in a' 5 percentage 

point range of one another. ' * . . / ^ - ^ 

^ 2. Regression Analyst's of Job' Finding' Rates • \ , . * • , 

In this section we shall evaluate the impact of th? experimental treat-.' * 

ments on the job finding rate using regression analysis. The purpose .of • 

• . ft 

doing this is to test whether the effects observed in Table A'-^'.are signifi-.' • * 
cant and persist when other variables are .controlled for. In parrticular, . -. 



107 



■84- 



given the possibilitynOf difference between treatment groups (even though 

there was random assignment in both cities), i1;is desirable. to control 

• '« < 

for variables that ^ay differ between groups. 

f » • ' • • * * 

The regressions are run only for job finding as of the first fspllow- 

up since sample sizes become too. small for later follow-ups. The dependent 
variable is a durriiTy •varia\)le indicatitig^hether or not the individual found 

— I 

a job by the -time of the first follqw-up. Independent variables include 
as control variables a series of 'dumny variables for sex, race:, (not 'for 
Wilkes-Barre where the sample included too few. non-whites) , age, family 
status, receipt of public assistance, dropping out of high scho.ol, and high 
school graduation (not in Cambridge). In addition the STEP sc*or*e of read^ 
ing ability ,from the ETS instruments is us^d.. To test the experimental 
effect in Camtiridge, a dummy variable is used indicating* whether the person ^ 
was assigned to the Job Factory or thfe Control group. .In^Wi Ikes-Barre, 
two dunmy variables were used, one indicating assignment to Sroup 2 and. the 



^ oth&r to Group .3. Jhe^implfc^'t comparison here is to Group 1. Results 



2 

appear in Table'$-6 



Ini^ambridge palrti'ci^ation^in the Experimental group is signific 



cSint 

and is the only significant ^variable'.. 'The oyeral 1 ^explanatory powtsr of - ^ 
uf - the -^egrfession' is weaK. Basically this regression result suggests that j 
rn our sample it is* Sufficient to compare job finding rates ; there _is no 

\ no gai.n from jcontrol. ling for the other variables* availab^le to us" ^ 

^ «f ft* « _ * 




* \ ^The use of -61$ estimating technique^ in the presence of a dichotomous 

dependent variabrle (such as Job Finding)* introduces a number of prdblefns.' 
The u^e of OLS estimating techniques under auch "conditions, will produce 
unbiased^ but not efficient estimates of regression coefficients. The 
' use of techniques such afs logjj; would, however, not likely change the 

significance of coefficients- reported in. this chapter* s tables. See': ' ^ , 
' ' Johnston', J%^ Econometri c Methods , McGraw-Hill Book Company: New York,. 1963. . 

3we tested' the regression result's to make sure that the results were not 
/ influenced by the timing Of the. administration, of the first follow-up. 
^ questionnaire. They were riot. * ' . , ^ . ^ . - ^ 
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^Reqressi'bo Analysis of Job Findina Rate at First Fallow-uD 




' . ■ Cambn'dqe ' * 


Wilkes-Barre . ' t 


^ublic Assistance . 


.0636 . 

(.1277) ^ 

.00^2 
(.0700) 


« 

.2946 . . 
(•1521) , 


•emale 


-.01^6 ' , ^ J ' . 
(>.0709}. 


uack or 'Hispanic 
1 ' • 


-.0181 
(.0696) 


(excluded b|(tause of too 
few„ non-whites) 

-.05^1 - • , 
(.0777) 


\pe 16 or 17 


.0184 . ■ • 
■/ (.1020) . 


tee^jl of Household- 
Independent of Parent 


.1334 

(.0784) , ■ • 


* 

.2773 

(.1182) . ' 


I.S- Dropout 


-.0433 
(.0791)- 


- -.066r ' • V ' 
(.1484) ' . ' 


i,S. Graduate 


. (not used in Carribridge)' 
• 


- .1010 

(.0898)- X 


Step Reading Score 


-.0012 ^ ■ 
(.0007) ' 

• 


-J0012 
(.0006) 


Experimental Group 
, {Cambridge) 

Group 2 
(Wilkes- Bar re) 


* 

.2154 

(•0846)^^^. 


' * \ 

-.1414 

(.0832) , . ' 


GrouD 3 ^ 
(Vlilkes-Barre) 
Constant 


•/ - 

I ^ .3522 7— ^ ^ 


-.0325 
'(."0866) • 
.7255 




< • 

.054 , - 


.114 


n 


207 


165 


• 

f; . 


■T.41 _ " 


2.22 


Notes;^^ . ' 

1) Dependent Varia"bl 
first follow-up. 


e: equals .or>e if person found job (full or part-time J by time of 
zero otherwise. *^ .^-^ 


All independent variables except for STEP reading scor^ 
one in indicated condition, zgro otherwise. 


are dummy variables which equal 


2)" ^Indicates significance at .05 level using one tail test >^or experimental group; / 
two tai] test for a;il other variables. ^ 


•3) Standard errors- in parentheses, ' 




4.) Logit analysis yields essenMally the same results. 
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In Wilkes-Barre, the only significant variable is whetheY the 
person lived independently of his/her parents. The variables for the * 
treatment groups are not significant. • , 

Basically, the 'regression results for Cambridge supports^the . 
impression from the job finding rates themselves that the JobL.Factory 
has a substantial effect 'in getting youth into jobs quickly. For Wilkes- 
Barre, however, the regression resuLts suggest that any differences between . 
groups are too small to be ' signal fi cant. If the supposedly more intensiv^ 
treatments in Wil-kes-Barre' had an effect, we*are unable to detect if. 
This finding was confirmed by the data reported earlier in the process 
chapter on hours of treatment, among Wilkes-Barre groups/ - . . 

3* ' Characteristics of First Post-Enrollment Jobs ^ 
- Direct comparisons of both the job finding rates^and the regression 
analysis support the*ideci that the Cambridge Job Factory treatment gets 
more»youths into jobs more quickly than no" treatment. However,. the job- 
finding- rates show that those in the Control group are just as likely^ 
to find j%bs eventual ly--within 45 weeks— as those who wejit through the ^ , 
trecftment. Since the principal difference resulting 'from treatment is the * 
speed of joh finding, it is worth considering whe'ther speed mak^s a differ- 
ence in the quality of job found. Although yoi^t^ .1^ general take secondary 
labor market-or.iented jobs, the shorter seatch could push them prematurely into 

s 

the less attractive of these jobs. Alternatively, the treatment could 
reflect those who benefitted by finding^ good jobs quickly. This section 
will test, whether there are noticeable differences between treatment groups 
Tn either direction along several dimensions of job quality, 
w Table 4-7, summarizes some observable characteristics of, the first job 
found following enrollment in the program*. In Cambridge the median's of 
the wage, of weekly hours workedj and of weekly earnings are all slightly^ 
higher for the Experimental group ^th an for the Control group. Slightly 
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' Table ^4-7 ' . 

Characteristics of First Post- Enrollment Jobs 



Camb^ridqe 



Wilkes-Barre 



ExDeriiiienti» 



Control 



Group 1 



■Group 2- 



Group 3 



edian Waae 

edian Weekly 
Hours 



$3.50 
(B8) 



39.6 
(91) 



$3.40 
(51) 



37.6 
(51) 



$3.10 
(43) 



25.0 
(43) 



$3.10 



29.1 
(49) 



$3.10 
(36) 



25.3 
(38) 



edian Weekly 
Earnings 



fercent Unsub- 
sidized 



d31.25 
(87) 



80.2 
(101) 



124.03 
(51) 



83.6 
(61) 



62.00 
(43) 



76.1-' 
(46) 



92.94 • 
(48) • 



86 ."S"^ 
■ (53). 



81.85 
^6) 

76. V 
(43) 



Percent Full- 
time 



67.3 

•(101) 



52.5 
(61) 



32.6 
(46) 



•35.8 
• (53) 



25.6 • 
(43) 



Sample sizes (in parenthesis) include only job finders for whom data ^are available on 
the indicated variable, , The first job is identified by moVinp from one follow-up to 
the tiext unti-1 a job is neportedv Full*-time is defined as 35 hours or more per week. 
Full-time is definefd a^ 35 hours, or more per week.. Mean wafijfes, hours and earnings 
in Cambridge are reported. in Appendix F and agree with the interpretation given in 
the text. 
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^ 4 

more jobs found by those in the Experimental group ar^^subsidized. Substan- 
tially more are full-time (35 or more hours per week) nather than parti^time, / 
accounting for the finding that earnings are slightly higher using Job 
Factory youth at each follow-up period. Most of these differences are small, 
but they are generally in favor of the Experimental group. We may conclude 
that the quicker pace of job finding for the Experiipental groiifi^does not 
lead to worse jobs, but if anything, to slightly better jobs. 

FoK Wilkes-Bar re' there is no difference in median wage across < groups • 
There is, however, a larger number of full-time jobs in Group 2 and correspond 

m 

ingly higher weekly hours and earnings. Group 2v youth also find more un- 

subsidized jobs than Group's 1 and 3^- Thus, although there is no apparent 

advantage in job finding for Group 2, this enriched version of the Wilkes- 

Barre program leads to slightly better paying jobs in the unsubs^dized §ector. 

Part-time work is much more common for all groups in Wllkes-^arre than 1rt' 

Cambridge. * • ^ 

Another measure of job quality is provided "by the- Occupations Status 

Scale which is shown in Table 4-6. The. scale runs from 1 to 5 with 5 the 

highest status. However, except for a handful of cases in Cambridge, 

k - 

youth in ^ur sample do not score above statas 3. The Control- group in 
Camljridge has a higher percentage in status 3 than^the Experimental group, 
In'Wi Ikes-Barre the proportions- in status 3 are higher for Groups 2 and 3 
than for Group 1. Al thought status 3 includes occupations like file clerk, 
receptionist^ aqd cashier, it, is not obvious that these jobs really repre- 
sent higher status thSn laborers (status 1) for the youth wffo are \r\ our. 
sample, the information in Table 4^fi is perhaps best treated as a 
description of, the distribution of pccupations without being, too concerned 
about the ranking in terms of status. 



§Thi$ i\iay be explained by the slightly higher rate of SYEP participation 
after Cycje 1 among participants than controls— see Chapter III,. 
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■^ Table.4r8 



""^^ Ocdupational Status Scale for First Job 
. /(percents of Job Finders as of First Follow-up) 



Cambridge 



Wil kes-Barre 



Expferimetit 



Control 



Group 1 



Group 2 



Group 3 



L Laborers and 
low level Ser- 
vice workers 

2. Service 
workers; lower 
level crafts 
and operations . 

3/ Clerical , 
crafts and kind- 
red 

4. Higher status 



Sampl^e Size 



23.1 

21.5 

47.7 
7.7 



65 



19.4 



16.1 

64, 5 

0' 



31 



33.3 



25.6 
0 



39 



17.9 



41.0 ' ' 46.2 



35.9 
0 



39 



Source:- The Occupational Statu? Scale'us'es status codes from "l"'(1ow) to' "5" 
■(high). It is a composite scale developed by ETS of several conventional' status ■ 
scales (e.g., North-Hatt, Bose, Siegal Prest>ge Scales). Codes are available from 
the Educational Testing Serv-ice, Princeton, Hgw Jersey. 



14.7 



44.1 

41.2 
0 



. ^34 



\ 
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One important coacern when evaluating job quality- is, how long the 
job lasts. If a job search program Tushed youths' into jobs only tQ have ^ ' 
them leave soon afterwards, the success in job finding woujd Be, less 
valuable than it initially appeared. Table 4-5 ha? already p^esented 
data relevant to this question for Cambridge, (For, Wi]kes-BaVre where 
there is little difference between groups, it .is not an issue:) It should, 
be no'ted that sample sizes are small, so that these results cannot be con- 
sidered definitive. In addition, the most common category of $ubsequent 
experience is that of incomplete information (Ic in Table 4-5 *for those^lnitiaLly 
working, 2b for.those who had found jobs). Nevertheless, it is interest- " 
ing to note in Cambridge that theVate of job leaving (2c)' is lower for the^ 
Experimental group than for the Control group. While not conclusive, this 
result certainly lends no support to the hypothesis that speedy job finding 
ends* in early job leaving. The record of job holding among those ^going 
through the Job Factory appears at least as stable as among those in the 
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Control group. • • 

Considering the various^ measures of job quality that we have pre- 
sented, the numbers on most suggest at least slightly higher quality in 
JCambridge for thos'e going through ^e Job Factory, Allowing for the small 
samples, we can say at least t^at we have no evidence that the Job Factory 
leads to jobs of lower quality (within the range of jobs in the youth labor 
market). For Wilkes-Barre there ar^ Jimitfed data that youth enrolled in y . 
the most enriched Wilkes-Barre treatment (Group 2) find slightly more full- 
time jobs and unsubsidized jobs. Overall, however, there is no clear indi- 
cation that one treatment group leads lo 'higher--or lower- -quality jobs than 
the others;^ Added to the earlier finding of no significant-effect on job ... 
finding rates, this reinforces the impression that yariations in treatmetft'v 
in Wilkes-Barre made no difference, - > 

■ . ■ „ . lU 
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C, Results of a Psychometric Analysis 

-One possible channel by which a JSA program may affect youth labor 
force and employment behavior is that it may transform youth attitudes 
or knowledge areas in a way that makes them more likely to find jobs 
quickly. This section will present an analysis of whether such a 
transformation took place in the programs we studied. The analysis is 
assisted by the development of a set of instruments to measure work- 
related attitudes and knowledge developed by the Educational Testing 
Service (ETS) for the Department of Labor's Office of Youth Programs. 

A large' nunt)er of preytou? studtes examined the sociological, 
economic, and attltudlnal predictors of early work experience and career 
choice, A smaller number of other studies have focused on the socUl- 
psychoTogical orientations of youth in training programs. No study 
beyondfthe present one has examined the specific role that Job sj6rch 
assistance may p,lay in transforming orientations to work,^ 

After first prese.nting the ETS measures,, this section will evaluate 
whether there is any effect on attitudes and job knowledge attributable 
t6 a JSA program. It wilT then examine whether our measures of altitudes 
or knowledge areas are related to success In job finding. 



Pre-YEDPA studies are numerous: for a literature review of the role work . 
attitudes play in the school-to-work transition, see Raelin (1980). 
See also Gottlieb (1974) and Hahn (1978) on the general topic of work ♦ 
, attitudes^ -> . 

On the longitudinal, relationship between work attitudes and work experience, 
see A'ndrisani (1977); ; • - , ^ ' 

Qn youth in the Neighborhood Youth Corps and MPJA programs, see Coorfan 
(1977); Egloff (1970); Gurin (1 970); and Walter, et al . (1968); 

On young Welfare recipients, sea Goodwin (1971); 

Relevant YEDPA studies are noted in the text. One recent study by Rock 
and Freeberg (1980) is of particular interest. 
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V. The^ETS Psychometric Scales 

Our study is part of. a national efforts collect uniform data 
on yoiith participants enrolle*d in a number of special demonstrations across 
the country- funded by' the Department of LabDr. The effort consists of 
-numerous independent program evaluations using a common data base developed 
.-by the Educational Testing Service (ETS) called the Standa^-d Assessment 
System (SAS).' The ETS/SAS 'includes a battery of seven pre- and pos,t- 
program (exit) /tests that measure various aspects of social -psycholo^'cal 
work orientations, as well as a reading test (STEP) administered during ^ 
the pre-program testing period. ^^^^^^^^^ 

The seven pre- and post-psychometric scales derive from relatively 
short paper and^encil tests. The tests can be presented orally to small 
groups 'and are(^designed to be suita4)le for adolescents from low income 
backgrounds. In the context of job search assistance programs, not all 
the scales are of equal interest. Several, such as the Job Seeking, Job 
Holding, Job-Knowledge and Work Relevant Attitudes scales are esp^ecially 
relevant because the purpose of job search assistance is to teach such 
s.kills. Other scales such as the Vocational Attitude, and Knowledge 
0^ Sex Stereotyping of Occupations tap dimensions of-knowledge or ^awareness 
that are only indirectly associated with the job search assistance concept. 
The self-esteem scale may , be relevant M one believes that it is*group " 
process and individual counseling that is the root of tRe job search' assist- 
ance program concept. 

The seven, scales are briefly described below:^ 

1. Job Kndwledge Test* tJK)— a scale dealiiig with the requirements, 
tasks, and qualifications of various jobs depicted in verbal 
and pictorial , formats. 



For further information arjd reproduction of the ^ests, see. The Standa rdized 

Assessment System for Youth DemonstratiCn Projects . Educational lesting 

-Service, March- 1980, Princeton.; N.J. Printed as Department of i."abor Report 
1.6,, Youth Knowledge Development Series, GPO, Washington, D.C. ' ' 



Job Holding Skills (JH)— a scale dealing'wUh ttve youths' 
understanding p.f appropriate. behay'ior .ofi jobs itnd interactions 
with supervisors and co-worker;^. - * / 

Job Seeking Sfcdlls (JS)— this scale^provldes an assessment of > 
,ski lis necessary to begin job search-, sort information relating 



• to potential jobs, and understand the requirements of^a job 
application. 

4. Vocational Attitude Scale (VOCAT)— this is an abbreviated 'form 
of a well- known ^scale probing levels of vocational development. 

5. Self-image (SELF)-;-this sca^le plumbs the* participants' .feelings 
"^f personal worth and his/her expectations for the future. 

6. * Work' Relevant Attitudes (WORKATT)-^-the scale measures a variety 

of work orientations, such .as op'timism and self-confidence in 
the world of work. • ^ • * 

7. Sex Stereotyping of Adult Occupation^ (SEX STERE0)7-thi$ scale 
asks participants to rank different adult occupations in terms 
of "wT)o should be a . " 

' In Cambridge, youth^in the Job Factory program took^ all the pre- 

and' post-program tests, wMle control group youth took llqlx^e pre-test 

at the time they were administered the first post-program tfol low-up 

■questionnaire (timed at about six wee1<s after the participant youth left 

the program). ' In Wil keft^Barre, all youth" Were sCTpposed to take the full 

• t' 

set of pre- and post-tests. 



tested the reliability of the scales for our samples. Jhe 



measure oY reliability is strictly a staliistftal one. Table 4-9 sho^s 
the rel^ability-of the scores* Examining, samples of youth from each 
community, the scales possess sufficient reliability to warrant con- 
fidence that potential' change f rom .prer to- post-test could be documervted.* 
When disagflregated by sex.^- ^however, tfiree scales- have low r^iability 
scores. Table 4-9 indicates '%1stat' femal e scores on the dot^^lding scale 
in both study samples, and female ^eores-in Wflkes-Barre^ on 'Job .Knowledge 
are examples of scales with low reliabilities. Data invol v4ng^tf(tese female 
scores must therefore be interpreted cautiously. ° . 



iistical\J:€ 



Reliabilit:y" is defined here in statist! cat\J:enns. The Cronbach Alpha 
coefficient formula for standard, scforfes is calculated from the numb^rof 
items^comprising a scale and* the abllity-of the items to share commorT" 
meaning. The formula is: ' . 

r = k R-k ^ * • . * ■ • . 

kk p-p - where k = number of items ^ 

, ' ^ 4,'- R = ,k J- k^rij-krij 

rij^- average 'inter- item correlation 

The v^Jidity of the ETS/SAS scal'es wtl>Tio^ be discussed in the text, that 
is, wh^threr the. scales are appropriate to the purposes for which they are/^ 
used.' Data on criterion-related •and, construct validity a>e adequately 
presented in publications cited in Rpck and Freeberg (1980)^nd available 
from the Educational Testing Service, Princeton, N.J. ' A. third form of 
validity— content validity—is mcke dtff^tcult to' document empirically,, 
since as Nunnally has noted, it "inevitably— rests mainly .on appeals -to 
reason regarding the adequ^acy with which tlie .content has.^5een cast'in " 
the form of test items."' (1978:93). There has tfeen debate in the field 
over the content validity of the EJS/SAS measures. To the best ofN the 
authors* knowledge, however, noigj^etter standard measures exist for the 
purposes described in thrs section. Nqnetheless,:^the;field woul d cer^ 
tainly benefit frorfi improved measures of job seeking skills and^the like. 
These "measurement issues" are impor*tant in interpreting results in the ; 
f 0^1 lowing sections. ' . . ^ , 



Source: Nunnally, 1967:195 



Table 4^9 



Characteristics- of the ETS Pre-Test Measures 



1 



















ETS Measures 


#Test 
Items 


Cambridge 

Pre-test 

Means 


Wil kes-Barr^ 

Pre-test 

Means^ 


Cambridge 
Pre-test 
Reliabllity3 
(alpha; 


W1 1 Kes-oarre 

Pr^-test 

Reliability3 

lai pna ; 


Reliabil 
Cambridge 
. Male Female 


Vocational 

Attif ijHp 

\ 

Job Knowledge 




- 21.3 


22.9 


.735 


.712 


.686 


. .797 


30 


22. .6 ^ 


23.9 


.690 


. .598 


.533 


, .78& . 


Job Holding 
'skills 


11 

t 


30.0 
(2.5) 


, 31.1 
(2.0) 


..5.41.. - 

• ^,0:^ • 


,.*548 


!.617 


,256 


Work Related 
Job Seeking 

SKI 11$' 


16 

• 17 „ 


48.3 
12.9 


51 .4 
(6.3) 

' 12.9 


.787 
^ ' .750 


■.77if* 
.602 


.750 
.717 \ 


.833 , 
.768 

i ; 


Se^ Stereo- 
typing 


21 < 


48.0 
' -(8.6) 


N 46i4 
(8.5). 


.912 


.911 


.915 


.892 


Self-Esteem 


15 


36.1 
• (3.3) 


36.2 , 
(2.9) 


' .606 


.627 


.517 


.658 

s. 

*- * 


Dat^a. reported for sample of Cambridge -experiment CN = 
post-tests. , * ' - 


104) and WiTk^s- 


■Barre youth (N '= 


224) with matched 

• 


■;Stebttdard deviations in parentheses. 










• 



ty Alpha^ 
' Wilkes-Barre 
Male Female 



.735 
.712 
.590 
.760 



.589 
.369 
.200 
.791 



.633 
.889 
.639 



.483 
.912 
.624 



J 
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Nunnally (19|7:' 226) considers relflbiUiies between .50 and .80 adequate for basi 
between meanf for experimental treatments. ^ . 

ii3 • • • 



c research on the differences 
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2,. The Efffegj^^.JSA on 'Attitudes/Knowledge Areas . • 
S1nc| the attitude scales, were' measured both before and after pro- 
gram participation, we can subtratt the pre-test score from the post-test /• 

score to constructa gain score for each IndlvldualXEffects on attitudes* - 

\) r N 

win be studied first by comparing gain scores and second by introducing • 

control variables other 'than JSA treatment that might affect attitudes 

through tfje use of regression analysis, ThroughoutM:hese tests, each of . 

the seven scales is tested separately, • \ * . 

— ^n evaluating tbe gain scores it should be remembered that we have no _ 

post-test scores for the control group in Cambridge and therefore no gain 

scores for these individuals. However, the time between pre- and post- test 

for the ExpeiMmental gfoup is sufficiently short (about three weeks on the 

average) that it may be reasonable to assume that in the absence of trea^tment 

there should be no, gain. Assuming zero gain /or -the Control group, a test . 

of treatment effect is whether the gain score for a treatment grouj) is ' 

significantly greater than zero, ' * ^ ' . 

Table ,4-1 OA presents mean gain scores for Cambridge, Table 4-10B 

for Wilkes-Barre, The only pQsitive significaalt gain is in Vocational ' 

» 

Attitudes in Cambridge,^ This is a scale we would not have expected to be 
influcenc^d by a JSA prdgram-: Three scales actually had negative signifi- 
cant gain scores, including' Job Seeking skills in both^ cities. Other score 
changes were.jimply insignificant. Thus, thjs test provides no "evidence 
of significant positive gain resDlting from treatment except for Vocational , 
Attitudes in Cambridge,* where the gain is difficult to interpret. In' the 



-97- 



Table 4-10A 
Gain Scores 



Cainbridge 





(1) 




417 

(2) 




« 


ETS Measures 


Pre- test- 
.X SD 


« 

Post- 

X 


test 
SD 


Gain Score's* . 
,^(Post minu^ Pre) 


« 

Gain * By ** 
Pre-test SD 


Vocational Attitude 


21.3 


4.0 


.22 J 


4.5 


J39* - 


■ .18 


Job Knowledge • 


22.6- 


3.7 


22.0 


4. .6 


-.571 


-.15 


Job Holding Skills ' 


30.0 


2.5 


29.3 


3.9 


• -.679* ' 


-.27 


Work-Relateid Attitudes/^8.3 


7.0 * 


49.0 


8.2' , 


.487 " 


.07' 


Job Seeking Skills 


12.9 


3.2 ^. 


12.2 


4.1 


• . -.692* 


-.22 


Sex Stereotyping ^ 


^ / 47.9 


8.6 


'47.2 


10.1 


-.841 


-.10 


Self-Esteem 


36,. 1 


3.3 


'35.7 




r.445 ' 


. -.13 



ERIC 



♦Mean ^core differences are significant at the .05 confidence level by t - tests for paired sampTes.(two tailed test) 



**We employ t - tests to determine the significance of differences between pre apd post-test means (Col. 3). 
This approach utilizes- the standard deviationsof before and after tests. Some authors using the ETS/SAS 
data have used t - ratios (gain scores divided by pre-test standard deviation. The latter approach (Col .4) 
employs less information and therefore we prefer to use Col. 3. . 



122 



123 



-98- 



latter case^ there is'nothing in' the. JSA. program concept to suggest tljat 

s 

change in vocational attitudes would be likely. 



■ i 



3^ 



Q 

" Comparable results' have been reported 1n recent studies. Fd>\example, 
Chapt;er~II noted that the 'Youth Career Development project iovbJving the 
U.S. Employment Service is related 'to the job search assistance concept. 
Pre- to post-change on 3. ETS/SAS scales tieci to job search education— 
Job. Seeking, Job Knowledge afrd Job Holding skills— were all unchanged 
positively by participatton in the ES/YCD prograjn (Rock and Freeiierg, 1980), 
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ETS Measures .* , Pre- test 

X SD 

Vocational Attitude 22.9 3.8 

Job Knowledge 23.9 3.0 

Job-Holding Skills 31.1 2.0 

Work-Related Attitudes J1.4 * 6.3 

Job-Seeking Skills ,12.9 2.^ 

Sex Stereotyping 46.4 8.5 

Self-Esteem 36.1 2.9 
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Table ,4-lOB 
Gain Scores 

Wilkes-Barre 



J 



Bost-test Gain Scores* Gain ■» By 

X SD ' ^ (Post minus Pre) Pre-test SD 

•23.0 4.3 • .107 .03 

23.7 3.7 -.214 , -.07 

30.7 3.0 -.398* ' -.20 

^51 .2 7.2 -.167 

12.7 2.7 -.228 -.10 ' 

46.1 9.0 ; i^.364 -.04 

36.1 3.3 .017 . ' .01 



0 



•100- 



The,pbs^ved pain scores may, of course, be attributed to- some 
■factor other than treatment. The' ideal test would be;, to regress gain 
score on treatifien^'and otheV' control variables. Unfortunately, we do 

• not have gain' scores, for the Cpntrol group in Cambridge; the Control 
group would have to'be included to test the treatment effect. As 
a second best option, we coulcl think of repressing post- test scof'e 
on treatment and (Jther variables. Although there are no post-test 

'.scores ftfr the Control group, we could again assume no systematic 
difference between pre- test and post- test for the Control group. This • 

r 

suggests a dependent variable equal to the post- test score for those 

I 

in the Experimental group and to the pre- test score for those in the 
Control group. What emerges is thus a test of whether post-test scores 
of the Experimental group differ significantly from pre-test scores of 
^ the Contral group after controlling for other variables. 

Eaclj attitude scale was used as a dependent variable in this type 
of regression. In Wilkes-Barre, with the exception of the scale for Job 
Seeking skills, treatment group was never significant, with other background , 
variables occasionally significant. For evaluating a J§A program, ttie most 
relevant of the psychometric variables is probably Job Seeking skills. Thus, 
Table ^-Tl presentsthe regression results for this dependent variable. In 
Cambridge, experimental treatm^t was not a significant determinant of 
this scale; again, it was not significant for any other attitude scale. 
However, in Wilkes-Barre, Groups 1 and 2 had significantly higher job seeking skill 
scores^ than Group 3. This is a perplexing finding since Group 3 was supposed to 
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TABLE-\4-n 

Regression of Job Seeking Skills Scale on Treatment and Background Variables 



I ndepende nt yVa ri abl es 


Cambridge 


Wilkes-Barre 


Education S.tatus: Dropout 


-1.7011* 
-f.6797) 


-.5793 
^ (.6828),, 


High School Graduate 


— 


.9111 
(1.2432)1 


Sex: Female . ' 


.5742 
(.6039) 


. ..5679- 
(.3747) • 


Age: 16 or 17' 

1 


: -.0'938 
(.7529) 


' -.0602 
.(.3894) 


Reading Level Scale 


,0039 
(.0058) 


.0028 
(.0035) 


Family Status: Head or non-dependent 


.8449 
(.6546) 


.3975 
(.5689) 


Public Assistance 


. ..4582- 
• (1,0643) 


-1.4750* 
(.6875) 


Ethnicity: Black or Hispanic 


-*8544 
( .6099) 


— 


Experimental Group (Cambridge) 


-;2108 
( .6807) 




Group I (Wilkes-Barre) 




1.4737* ' 
(.4560) 


Group 2 (Wilkes^^arre) 




1.1310* . 
~ { .4482) 


' Constant 


13.0028 


13.0325 


r2 ^ 

N 

F ■ • 


.0660 ; • 

160 
1.34 


.1025 

222 
2.69 



Dependent vari'able in Cambri-dge = post-test score if individual in experimental group 

. • ' = pre-test score if individual in control group 



In W-^lkes-Barre, dependent variable = post-test score for all. 
•Two tail tests ^t' .05 significance level.. 

erIc " . ' • -f^s 



reVeive job search skills workshops. The*one treatment it did not receiVe*^ 
was job placement. services. On the other hand,* the process study reveals 
how few workshops wfre actually f^un.. If our result Is. valid, it perhaps 
mgans that formal -instruction 'in search -techniques is a less usefu.l* 

way to develop s-kills'thah iihe "learning. by doing" that might result * 
after' receiving- placement s.er,vices. Given the process results., even thi-s 
interpretation for Wilkes-Barre must be treated cautiously, 

. 3. The Effect of Attitudes/Knowledge Areaa/on Job Finding 



This section will test whether any of the' scales has 



a significant 



•effect on the job finding rate. 'Basically, this analysis e)kends the 
regression analysts of the job finding rate in Section B by adding the 
attitude scales as independent variables. Each attitude scale is tested 
in a separate regression. In Cambridge, 'no attitude/knowledge area scale* 
emerges as a significant variable and therefore are not s'hown here (except . 
as noted below). Together with our earlier finding of no significant 
effect of treatment on these scales,' this suggests that at'titudes/skills 
areas as we measure them do'not contriljute to an undef^standin-g of how the 
program in Cambridge worked. 

In Wilkes-Barre the scale for Job Seeking Skills Is h significant 
determinant of the job finding rate. Table 4-12 presents the regression ,, 
results for both Cambridge and Wil kes-Barre- With t his scale included as 

I a 

an independent variable. The post-test scope is used for all those in an 

experimental treatment group and the pre-test score for those in the Control 

group in Cambridge. Since Groups -1 and 2 in Wilkes-Barre had significantly^ 

hightr scores on Job Seeking skills and since this varjable affects the job 

finding rate, it appears that treatment may indeed have an effect 1n Wilkes- 

Barre, although the earlier test omitting attitude variables found no effect 

The effect does not show up directly, but rather in the twcr steps presented 
«» 
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Table 4- 12 



The-^Effect of\ackgroimd CharacteH sties and'Job Seeking Skills- 
on Job Finding (First F.ollow-.up). With ;)SA Tfeatment • ' 



Independent. Variable's. . '\ 


4- ; 

Cambridge 


Wilk6s-Barre 


> 

.Jjob Seeking Skills 




(.0212)^ 


. ■ ' •* 
{.0167> 


Education Status: Dropout 

. ■ • / • ' • 


(.1142) , 


A ' 0990 

(.1697) 


' ' : High-School 
~. Graduate - 




1.466B) 


Sex: Female 




- • Uv/ o 

(.0937) 


(71697) 


Group: Cambridge Experimental 


* 

f .z^^i 
(.1059) 


VI 


': W-B Group 1 




- 


^ (.1049) 


W-B Group 2 


0 

• 




-•iou/ . , 
1.1013) 


Age: 16 or 17 ^ f 




(.1140) 


^ 1 1 1 c 

(:o89a) 


Reading Level 


1 . ■ : 

1 


.. {.0010} 


-•UUiU 

*i (.ooon . 


Family Status: Head or » 

Non-dbpefident 


.2172 
. (.1090)" 


,:2768* 
(.1292) 


Public Assfstance 




-.0310 ' 

\ • 100^ ) 


% .3470 


/Ethnicity: ^Black or 
Hispanic 


V 


- 0286 
(.0947 ) 




Constant ' " 




' .4367 ■ 


.1984 


2 

R • \ 




" .0822 ' 


M584 


N (Listwise Deletion) 


Of 


129 


125 


F ' 




1.084 . 


, £.165* 











EMC, 



NOTES: See t^ables for variable definitions ° ° ' 

? * Denotes significance at the 5 percent level • » 

*j^tandard errors in parenthesis » . 

\ ^ Attitudes: Post-tests for all Wilkes-Barre regressions. 

Pre-tests for the experimental group and 
0; * ^ post-tests for the control group in Cambridge. ' 
Two teiiT tests for tadeperrdent varlables^at ,05 leyel of signif>cance, 



here." iSince the' distinctive element shared by Groups 1 ,ahd 2*was job' 
pl^eicement'services, "we already argued that iV-may be the placement serv- 
ices that contri buted the growth in job' search'skills * Now if our 
measure of these skills contributes to job- finding, >t appears, that job 
placement services may I indirectly affect jBb finding. However, some 



caution is urged in accepting this interpretation in view of our inabiV- 
Ity to-f-jnd any direct effect -of Groups 1 and ?, a'nd hence of placement 
services, on the job finding rate when the attitude variables are omitted 
from the regressions* Also, a:s the process chapter shows, not every youth 
received the- planned treatments. We .can &ay^w.ith certainty, however,,, 
that job search/skills as measured by ,ETS sxale^ among youth in the self-*' 
directed JSA group (3) do not t:ontriVute to^ job -finding-.* ' /' ^ ^* ^ ^ . 
D. Job Search Techniques and the Intensity pf3earch \ * * 

Yhis section examines' additional .channels, by whtch the JSA treat- 

, ' ; . • ^ / • ; 

mehts might affect' job finding. One typ5, of channel is specific techniques 
that youth mjght learn from the program. The other is simply whether treat 
ment makes youth' search mor^jntensively . Actually, some of the psycho- 
metric scales supposedly measured skiTls as well as attitudes* In this 
section we approach the jfuestion of sjcills indirectly by observing, whether 
youth use different techniques In finding jobs depending on the kind of 
treatment received. Recerft evidende from the National Longitudinal 
sJr^ey indicates that, among unemployed youth, 86, percent reported using 
only one or two methods of job search, with* younger youth "favoring the 
more jnformal sources of information. • Other studies have shown that the 
great majority of youth take ^he first job offered, * regardless of the 

search methodJ^ * ^ 

r , / 

Borus, Michael, et al., "Pathways to the Future -^A^ Longitudinal Study-of 
Yqung Americans--Preliminary •Report Center fo^ Human Resource Research , 

Oh1t)^tate University^. January 1980. ; ^ 

^^Stephenson, Stanley,' Jr., "THfe Economics of Youth/job Search Behavi^," 
The Review of Economics and Statistics, 1973, 104-111. , ^ 



Sources of jjobs are reported *in Table 4-13A for Cambr'idge and • 
Ta*b>e 4-13B for Wilkes-Barre. For Cambridge one notable, but- not unex-^ 
pected feature of the table is *the -heavy reliance on assistance from 
program staff for those in the Experimental groyp. Recall t^at the assist- 
ance rendered is of the advice and emotional support type, rather than * ' , 
with actual job placements. Whether considering source of first job or 
most useful source, program staff are used at a rate almost twice .that 
of any other source. The Control group, lackirigJJiis' sburce, must rely 

more heavily on alternatives. * In particular, they rely much more heavily on 

♦ 

friends or neig^hbors and on publ ic- (non-program) ijnployraent agencies.. This 

type of 1n1;ormatio|/ does not reveal directly the level of job seeking skillsif 

The results do, however, suggest an impprtant^aspect of tre9tment that makes 

.it work: those In the Experimental group have easy and frequent access to " 

pro'fessional assistance. It may be that this access is more valuable than . * 

any body ofskills the youth may develop. • Indeed, 'to the extend that this 

is the case, there is no assurance^ that benefits of the program will carry 

over to the nfext spell of job-search ^hen the youth will no longer be 

participating in such a pro'gram.^V ^> " ^ ^ ' 

* For Wilkes-Barre the sample ^izes. are so small that significance 

cannot be jlidged. .Thene- is still a- heavy reliance on pr^i^gram staff, byt 

It Is not as large relative to other sources as 1n Cambridge,. Of course,- • - 

the treatments in Wi-lkes-Barre did- not Involve as frequent or intensive 

contact with program staff either. ' ^ ^ '^^ ' 




See Appendix D Yor a discussion on how counsel 6rs*- ratings of youth 
are related to job finding among the youth. 



Job hndingv^ources Used in Cambridge 



Source 



Percent Who Usjsd Source 
in, Getting. First Job. - 



Percent Who Found Source 
the Mpst. Useful One. 



ograh staff 



2. Friends or people in 
the neighborhood 



3. Newspaper ' 
4; Family ' 
5. Help-wanted 



^6. Church or community 
leaders 

?• Public employment 
, agency^ 

. 8. Private employment 
.9. Other 

10*. None of the above: 
I got It on n\y own 



Experimental 



33.0 

18.2 

17.1 
■ 8.4 
3.6 

0 

12.2* 

3.6 
{i.6 
12.2 



Control 



Experimental 



36.5 

14.7 
7.4 
12.2 

2.5 

26.9 

•4.8 
19.5 
12.2 



26.8- 

7.i 

10.9 
4.9 
1.3 



7.3 



2.4 



10.9 



Control 



0 

17.0 

9\9 
4-. 8 

P 

2.5 

14.-7' 

2.5 
17.0 



^amplie size (restricted 
to job finders) 



82 



41 



8| 



41 



? ^May add to more thar^ 100 percent since more than one source could have 
* used . ' ~ - - ' 



been 



b* 



Excludes respondents who did-nol indicate a mo§t useful source. 
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.4-1 3B Job Finding Sources Used i'n Wilkes-Barre 



Job Scoirce ' . ^ 


Percent Who Us 
in Getting 


>ed Source 
-irst Job 


Percent Who Fbund 
Source the 
' Most Useful One 




Group 1 


Group 2 


Group 3 


Group 1 


Group 2 


GrouD 3 


!• Program Staff 


22.0 


28.6 


1^.4 


22.0 


• 21.4 


13.2* 


2. Friends or People in 
the Neighborhood 

♦ 


17.1 


23.8 


28.9 - 


' 9.8 


21.4' 


15.8 - • 


3. -Newspaper 


7.3 


7.1 


18.4 


4.9 


4.8 


, 5^3 


'4. Family 


12.2 


11.9 


13.2: 


7.3 


4.8, 


7.9 


5; -Help-Wanted Sign 


0 


0. 


2.6 


p 


0 


0 


'6. Church or Community 
Leaders 


0 


, 0 


2.6 


0 


0 


_ 0 


7. Public Employment 
Agency 


9.8 


9.5 


13.2 


7.3 


^0.3- 




8.- Private Employment 
Agency 


0 


0 


2.6 • 




0, 


0 


9. Ottier . . 


7 3' 


4 (8 


15.8 , 


7 ^ 




1 U. D 


10. None of the above: 
- I got it on my own 


■ 17.1 


<16.7 . 


13./ 








Sample size (job finders) 
* 


41 


42 


38 


*> 

41 


42 


• 

.38 


• 

• 

9 


» - 


y 




* 
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Now consider'the intensity of search. Table 4-14 presents *two measures 

of intensity: the number of applications filed apd the number of interviews * 

attended. In Cambridge. there are more jippli cations and maay more interviews. ' . 

in the Experijfiental group than in the Contral group. The di'feferences are 
» # 

particularly pronounced for successful jobfinjJers. For non-finders the finding 
dqes not even hold.' It appears that an important element in't^e success -of • . 
the Gambri<Jge Drogram is its effectiveness 'in increasing the intensity of 'job ' 
s^rch efforts, aTthough^e res^lt'for nojirfinders suggests that the Cam-' 
bridge program was not uniformly successful, in motivating all ijts clients. 

Consider a related piece Qf evidence- -weeks to get the first job. The 
mean weeks for the Cambridge Job Factory youth was 4.77 compared 'to 4.61 among 
the control group youth. Thus, although more youth get jobs in the short run- 
through job search assistance, comparisons between successful joblpinders ^ 
(experiment and centrol) shows, no advantage in length, of time to find ^irst 
job. Similarly, when we, examine the ratio of applications to weeks to get a 
first job (at first follow-up) v^e find that the experimental group fills out . 
more applications to get this firs.t job, but the differences are statistically^ 
insignificant CO.7 vs. .02 applications/week to get job). Over all four follow-up 
periods, the raw dii^erences are even smaller (.06 vs. .04 applications/week, ) 
Thus, job search assistance leads to more job finding in the short run, but 
within the short run and among successful job finders, riot necessarily 
signi'ficahtly shorter job- search time. - ' ' , 

'These results raise the question of wfiTt it takes to motivate increased 
intensity. The ^estion of motivation can be considered in two parts: 
first, what does it taka.to get a person into the program; and . ^ 
second, once in, what does it take to motivate intensity of effort. The ' # 
process study shows that an important part of the motivation to»join in- ' 



the first place carae from a monetary stipend paid the'youth who attended. 



Tabl^ 4-14 Measures of the Intensity of Search 
A. Cambridge ^ * ° , 
Experiment^ Group 



Average Number of Applications Filed ■ 
. a. Among Job Finders 

b'. Among Non-Finders 



5.84 

•7:39 
(70) 
3.57 
(23) 



ControJ Group 

4.41 
3.73 

(30) 
. 5.38 
(21) 



Average Number of Interviews 
» »a. By Job Finders 

b. By Non-F'inders 



4 -.38 
6.02 
(59) 
1.73 

(22) 



2.47 
2.23 

(26) 
2.79 

(19). 



B. Wilkes-Barre 



J 



erage Number of Applications Filed 
a. Among ^ob Finders 

' b. TtoorV^on- Finders 



Average Number of Interviews 
a. By Job Finders 

li. , By Non- Finders 



Grouj) 1 


Group 2 


Group 3 


4'. 70 


3.75, 


7.70- 


4.86 


3.75 


8.77" 


^(28) , 


■ (32) ' 


(26) 


4.40 


3.75 


4.90 


(15) 


(20) 


(10) 


1.20 


l'.45 


2.63 


1 .39 


1.41 


3.00 


(28) 


■ (32) 


(26) 


.88 


1.52 


■ 1.83 


(17). 


(21) 


(12) 



Sample sizes are given in parentheses. Samples are restricted to those who 
answered fKe respecjtive qu^,stions on applicatioy^a^d interviews. . 

er|c ' 
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» * ^ 

While we dp»not have a formal test, the power of the stipend is supported 
by one development. Although each of the first four cy^cles in Cambridge 
paid stipends, Cycle 5 was planned as a cycle that would not pay one. 
However, only three youth signed up. As a consequence of this lack of 
response » a stipend was reintroduced, attracting a sufficient number of 
youth to run the cycle. ' ' . 

Once in the program we may speculate about what motivates search. 
First, there were penalties for not cooperating. In Cambridge, a youth 
could be "fired" in which case the stipend payment would be lost. The 
program also'-provided positive support to overcome the discouragement of 
rejections. It structured activities to get youth out in the field, ' 
applying and interviewing. Perhaps not least important, it must in some 
sense have been fun ta participate, fhese motivations did not work with 
all participants, but they apparently succeeded with the majority. 

Given the importance of intensity of search, we must consider 
whether the benefits* of the Cambridge program are likely to carry over 
to future ^spells of unemployment. It is possible that some youth would 
learn the lesson -of the importance of intensity and repeat the eftort 
again in the future. On. the other hand, it is likely that for many, 
the high intensity was a direct result of the immediate motivations th^ 
program offered. When unemployed without such a program available, it 
is reasonable to expect that intensity for many will be less because the 
structural* motivating forces will be missing, , * 

Consider now the three groups in Hi Ikes-Barre, The intensity levels 
in t'l^nns of Both applications and i^terviews^ are markedly higher for 
Group 3. 'Group 3 received job search skills workshops, but not placemen-t 
services. Of course. Group 2 received the workshops als,o, but had a 
lower intensity level,' If the observed int(5nsity levels reflect differ- 
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ences in treatment, it must be that those^ recefving placement services 
do much less searching. Combining this argument with the previously 
observed indirect effect of placement services on' job finding, we might 
conclude that in Wilkes-Barre, success comes from explicit assistance 
in putting youth into jobs. ^ Attempts to induce self-motivatedl search 
do succeed in getting youth to search more, but have no major payoff 
in tems^of job finding. It should be emphasized that the results and 
interpretations for Wilkes-Barre may not be completely reliable. However, 
they support the same notiop as in Cambridge that any success of the JSA 
results from the direct short-term services\rovided rather than from any 
transformation of the youth who go through the programs.- Our arguments 
suggest littleWsis for expecting future benefits from the treatment in 
subsequent spells of unemployment. 

' E. Program Costs : ' ^ 

Costs in both programs are not kept on an individual participant 
basis. Instead; we must take total program expenditures and disaggregate 
the figures into per person costs. Moreover, we should separate out costs 
that were supplementary to the direct provision of job search assistance. 
The most notable example of the latter are costs associated with the 
administration of the survey aspects -of the demonstration: ^n Cambridge, 
there was no staff time devoted .to survey administration since this 
function was assumed by a full-time on-site researcher. Therefore, the 

'e){penditure data for Cambridge in Tab.le 4-15 are accurate in portraying 
actual program costs. .In Wilkes-Barre, costs are deflated (column 3 of 
Table' 4-15) to account for research cos^s "passed on" .Jo the program 
operator. ' . • 
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Table 4-15 



\ 


program Expenditures 


• 


. . (1) 

'Cambridge v 
Job- Factory! ^ 


(2) 

Wilkes-Barre 
\ Workshop - 


• 


*■ 


Actual 


Personnel , Consul tants 
i fringe Benefits^? 


. $ 83,342' 


$127,747 

p 


Rent • 


16,214 


11,150 


Telephone 


6,534 


5,090 


Printing/Xerox/Advertising 


4,298 


2,880 


Video 


' 3,191 


J»IA 


Supplies 


10,055 


.3,250 


Furniture/Equipment 


J 

8,062 


5,525 


Travel 






Intentives/Recruitment . 


• ■ 2,240 ' 


NA 


Stipends 


54,843 


NA 


General & Admin. " 


9.048 


NA 




- $197,827 


$164,162 



(3) 

I Wilkes-Barre 
Less Demonstration 



$102,198^ 




$130,093 




Notes : 



1 



The. Cambridge budgetjs not the "close-out " budget; the latter is $5,110 higher. 

"Total expenditures #r Wilkes-BarrQ for personnel, except Project Director, aire 
deflated by 20 percent to a'ccount for costs attributable to testing and other 
demonstration activities. The 20 percent figure is an informed estinate*' 



'Excludes travel funds related to demonstration. 
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Consider now the costs reported in Tables 4-15 4-16 , 

The Cambridge program served 200 yo,uths'at a cost of $197,828: 
$989 per youth served. -From a socia.l perspective, the JSA costs might 
be calculated without the wages and bonus payments to parti'ci pants. 
Of course, there are social costs w,ith eliminating wagfes and bonus piyments 
since there are real costs in keeping JSA youth in alternatives; recall* 
that nearly one quarter of the Cambridge group receive public assistance. 
Nonetheless, on the basis of more wages and Bonus payments, the per unit 
cost was $715 per youth. In Wi Ikes-Barre, the program served 401 youth 

i • ' V 

at $410 per youth; The cost of rjjnning the^ Workshop without the special 
expenditures ^ the* demonstration wotild be $324 per yotfth. 

Tlext, we .calculate costs*%fer employed youth for^each program separate- 
ly; We determine the number of youth served who ever found jobs throuigh 
the periods covered by our follow-up surveys and divide that figure by ; 
total costs (net of' demonstration and stipend expenditures). .Table 4-16 
' line 5, shows the results. The Wilkes-Barre cost per employed youth is. 
^$611. In Cambridge, it is $1442. However, employed youth includes all 
those who found jobs. Some of thes^ jobs may be attributable to the^ 
program treatment while others would have been found anyway. In Cambridge, 
because of our exfieri mental design, .we are able to identify the net effect 
of program treatment. The net sbort-run cost per new job created by the 
Cambridge JSA program'is shown on line 6 of Table 4-16. The cost' is 
$4468 and is based on the following procedure. Since 'we argued that the 
principal effect of treatment appears in the short run, we takV the dif- 
ference in job finding rates between treatment and control groups ^y the 
fifst follow-up survey for all cycles combtned (see Table 4-2).. 
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TabTe 4-16 
JSA Unit Costs- 



Cambridge Job Factory Wilkes Barre Worksho p 



fl) Total costs per youth ^ 
served 



(2) ^Without stipends 

(3) Without demonstration expenses 

(4) Costs per employed youth 
(no stipend) 

(5) ^Xosts per employed youth 

without demonstration 
.expenses 

(6) ■ Costs jper net new job found * 

at .ls,t follow-up' 



$989 
715 
715 

1442 

1442 
4468 



$410 
410 
324 

711 

611 
N/A 



I. 



PRir 
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The T)erioji covered' is 10 Weks after JSA, enrollment and the difference 
in rates is 16 percentage points. Multiplying the latter difference^ 
times the total nulnber of youth served (200) gives the denominator which 
is divided into total costs (net of stipends). 1"his yields th« net cost 
per youth added to the world-of-work through job search assistance. 

The cjos*^ata are valuable in providing an overall picture of 
expenditures, but the figures have limitations. First, the impact and 
process study make clear how very different the two JSA programs are 
with respect to philosophy, approach and intensity of treatment/ As a 
consequence,'- comparisons between the two programs are hazardous. Second, 
direct service costs in the conte^^t of a federal demonstration are not 
reflective of' the economies that would be. made through Ipcal replications 
of the programs. Demonstration projects frequently involve large budgets 
that permit organizations to plan Start-u|i and Phase-down activities as 
well as to "pass-off" expenses (e.g., rent and equipment) normally absorbed 
by the recipient of federal funds. Third, some cost data may be dif/icult 
to evaluate.^ Consider' the $446^in Cambridge per net new job. The 
figurl could be overstated because the net benefit is expressed in short- 
term job finding and the jobs may be temporary. On the other hand, the 
benefit may be understated. There' could, for example, be long-term effects 
attributable to improvement in job search. skills. In earlier sections of ' 
this chapter we explored both hypotheses. Recall that we rejected th^ idea that 
the jobs found through JSA were more -temporary than control group jobs. But, 
we also rejected the hypothesis that JSA leads to T^- term effects. 
Instead, we argued' that the principal effec1i|Was in getting youth into, 
jobs quickly. The short-run new job cost of $4468 may, therefore, be 

' ' ' 
U2 : ■ ■ 



'fairly accurate* But, with no comparative data from o^'ther cpntrolled 
job search experiments, the figure cannot be judged expensive or in- 
expensive, 

F, Summary of Impacts • 

In this chapter we evaluated the impacts of job search assistance 
programs on the search behavior of participants. We considered differences 
in the rate of job finding, the quality of jobs found, and the persist- 
ence of the job finding effect. These results were examined in the 
context of a number of channels of effect--ways in which the^ impacts 
came about. The clrannels included: work attitudes/knowledge |reas; 
leamable search skills; and, intensity of search. The results'of the 
evaluation of impacts are' summarized below. Discussion of these results 
will be presented in Chapter V, Policy Implications. 

Job Finding ^ ^ , ' 

0 Over. all Cambridge cycles, the difference in job finding rates (without 
controlling for other factors) as of the first follow-up survey (10 - 

weeks after enrollment) was 16 percentage points, favoring the treat- 

■ I, 

• ment group. The difference in job finding rates diminished fon sub- 
sequent follow-up periods. In sum, the Cambridge" job search program 
had a large short-term effect, but going out to 45 weeks post-enroll- 
ment, there was no meaningful difference. Youth sooner or later find • 
jobs anyway, treatment or not. The effect of the treatment is simply 
to speed up the job finding, 

0 In Wilkes-Barre, there were no significant differences between treat- 
ment groups in rates of job finding (without controlling for lother 
' factors) at nine/Weeks after enrollment. Thereafter, small differences 
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appeared with Group 2 (who received placement services, rather than 
self-directed job search) paving the lowest rates while Group 1 
fthe "lean" approach 'that did not receive job search skills work- 
shopsj had the highest job finding rates. However, these differences 
were not significant. ^ • 

0 When variables such as sex, age, race, public assistance,, education 
status, and reading level were introduced H controlling factors on 
job finding, participation in the Cambridge JSA program was the only 
significant variable. Put differently , ^the Job Factory had a sub- 
stantial effect in getting youth to work, independent of these ^ther 
factors. In Wilkes-Barre, there was no significant effect of differ- 
N^^ent types of treatment on job finding. 

* Quality and Stability of Jobs Found 
0 In Cambridge, wages, hours of work^ and earnings were all slightly 
higher for the JSA youth than for the. Control group. Substantially- 
*more\jobs were full-time fflr the JSA group, - the Control group, 
however, found slightly more unsubsidized jobs,' partially in response 
to.'SYEP enrollments after: Cycle 1.- In sum, the quicker pace of job 
finding for Cambridge JSA youth le^i to roodeatly'^etteT^ jobs. 

0 In Wilkes-Barre,^ part-time work was more common than in Cambridge. 
, Jhe most enri ched treatment group (Group 2) found-more full-time ^jobs" 
than the self-directed group (3) whith resultecfMn higher weekly, 
hours arid earnings. Otherwise, there were no significant differences 
^ % between treatment groups in quality of jobs found. 
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0 In Cambridge, the rate of job leaving was lower for job search 
assistance youth than the Control ^rtfUp. Th)i data^ therefore gave 
no support to the hypothesis that speedy, job findin^'ends in early 
job leaving. 



0 In Wilkes-Barre no clear differences in job stability were identified 
•for the three treatment groups. Variations in treatment in Wilkes-Barre 
made na difference in this/j^b holdingMmpact. . ^ 

Work Attitudesy Knowledge Areas 

0 There w^e no significant po^sitive gain^ in attitudes /know! edge areas 
from pre- to post- test in either program, with the exception of 
Vocational Attitudes in Cambridge, 

0 In a procedure to determine what factors; in addition to program 

\ 

^treatment, are tied to attitudes/knowledge areas, we found that with 
*be exception of Job Seeking sicills in Wilkes-Barre, treatment group 
was^nevfer a significant determinant of attitudes/knowledge areas • The — 
. ^ • faptgtKat^Wilkes-Barr^^pi^ Xthe §elf-directed job search group 
who did rwf hsceiye placement services) scored significantly lower 
OR job,se&rcff^k'f^JSv<-v«hea^^^ controlled, suggested 

, that the placement '"^ervjce^ were Important in developing job search * 
.skills through a "leafrning b^^doing"' process rattier than the.'formal. 



instruction in search t^j^l^iies^^^^ Thi? integiretation must be tempered,^ 

* ' ' ' . . *' 

however, by the fact that 1:he 4)rl)ces5 study'reveals that services were 

not always delivered as planned. ^ ' . ^ ' ' 

0 In Cambridge, attitudes/knowledge areas 'did not contribute to job 
finding. In Wilkes-Barre, Job Searchp Skills were a significant de- ' ' 
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termlnant o'f job finding-. Thus, In Wilkes -Barre there may be an 
'Indirect effect^f treatment on job finding, with 'Groups 1 and 2 
. having higher Job Seeking sl^ills which In turn produce greater job 
finding. The d1st1ngu1»sh1ng feature of Groups 1 and 2 was the 
Inclusion of placement services, \ 

Intens1ty~of Search , , ' ' 

0 In Cambridge^ JSA youth cited contacts with staff more frequently 
than any other Item as a soun^e used most helpfully In getting ' 
first jobs. The' help was of the emotional type rather than placement, 

0' Indicators of 4ntetts1ty of search Included the number of applica- 
tions filled and the number of Interviews attended. We f^nd In 
Cambridge that the Intensity of search was slgnlflcan^tly promoted 
by the JSA program, mffst'notably for successful job ffrtders. In 
Wllkes-Barre, the process study as well as 'the Impact data on [ 

, Intensity su'gi&ested an uneven, pattern of search effort between 
groups.' Limited evidence suggested that Group 3 youth Interviewed 
and filled out^more applications; therefore, the ^placement services 
groups (1-2) do less searchi-ng. This finding, in'combination with 
the data cited previously, suggested that in Wilkes-Barre, success 
came fi^om the explicit assistance in putting youth into jobs. 
The program was too diffuse to generate successful self-directed . 
and motivated search arfiong the participants.' 



0 In Cambridge through the first follow-up period, when we compare weeks 
to get first job among successful job •findeV^s, there are no meaningful 
differences in search time between JSA youth ajjd-control §roup mem- 
bers. ^ Thus, JSA leads to more Job finding in' the short-run, but not 
necessarily to shorter search time among successful job finders. 
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Program Costs 

Costs per youth served, excluding demonstration expenses and 

■• 

stipends, were $715^ and $324 for Cambridge and Wilkes-Barre respectively 
Cosrts per employed youth were a modest $144? and $611 in Cambridge and 
« Wilkes-Barre '(excluding stipends and. demonstration expenses). The fcost 
per net new job created .through job s^arcjLJtwi stance in Cambri(i^ge Wjas 
.$4468. 
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Chapter- V 

- . Policy ImplT^tions - / 

♦ • * * • 

Job search assistance for youth appears to^^ork by sustaining 
Interest In active search. It may do this through financial Incentives,, 
through a program thatMs perceived as "fun" hj/ young^ persons, or through 
^ the fact that counselors are tl(ere' to marshal and ^^nforce youthful 
energies %hat might otherwise be dissipated. Whether there are long- 
term Impacts, extending into future spells of unemployment cannot be- 
deduced from our study of jOb search assistance. In Tact, this study 
shows that there^can be .significant shortrtenn effects, but these effects 
appear to diminish over time.. 

Successful job search assistance gets youngsters to initiate tffeir 
search sooner than they had otherwise planned and to pursue search more 
intensively over a period of time. The curricula dt the programs are ^ 
undoybtidly important in attracting youth to and keeping youth in the 
programs, but it' is not clear whether the various 0§A elements actually 
can be said to alter participants' attitudes or knowledge areas. It is 
the intensity of the program that is* clearly very important. 

This then raises the question of what sort of incentive it takes 
to get youth to participate in such a prbgram. We showed that in 
Cambridge the financial stipend used to attract and support youth during 
the program was a critical element of job search assistance. When the 
program tried to operate without stipends, it failed*. Similarly, ijiany of- 
Wilkes-rBarre's probl ems ^wi th underenrollment, failure to deliver all plann 
services, and low service hours can be attributed to a lack of financial 
incentive. , ^ . ' ' * ' 1 
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-The importance 'of personnel in preparing youth, but more import- 
ant.ly, in reinforcing the s.earch process, was' illustrated in both the 
process and impact analyses. Certainly, the frequent staff turnover 
and disruptive^ reassignntents in WiTkes-Barre influenced the employment- 
rciiated impacts cited in Chapter IV.' 

• Another important element is program design. The .Cambridge 
program is structured in a way that holds youths captive long 'enough to 
impart a sense of urgency and i^tentive to their search. By contrast, 
the Wilkes-Bafre program is diffuse and characterized by a lack of enjoyable 
group act+vities, as well as a failure to routinejy follow and support;' 
the youths during their selfch forjobs. 

The conventional wisdom is that job search assistance works in part 
because^of the peer support, group dynamics, and other program elements 
directed at changes in self-esteem, knowledge of the world-of-work, and 
knowledge of the job" search process. In this study, the program's short-, 
run -success resulted frotn the high intensity of search effort generated 

*v : • ^ .. .• 

by the program's service mix. We would argue that these program activi-^. 
ties-kwere important because they were fun and because they held the 
attention of the youth.' This does not prove -that the conventional wisdom* 
is -wrong—only that when job search assistance worked, it succeeded most- 
.importantly to the extent that it increased the intensity bf search. 
,Job search assistance Is important then not so much, for what itN teaches 
but for what it pronfetes--job finding;"^ 

Success from the 'job^search assistance programs results from direct' 
services provided, rather than a serious transformation of the youth who go 
through Jthe programs. W.e found little or .no evidence that work attitudes 
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or knowledge areas were Shaped by job search assistance pedagogy, or 
that such attitudes lead to job finding indirectly through program partis 

♦ 

cipation. As a matter of fact; in Cambridge tl\e direct effect of the 
job search program was found to lead" to positive short-fun employment 
effects-, independent of .these other factors. It is clear that the social- 
psychological orienJ:ation placed on job search assistance by. early 
investigators {see Chapters I-II) is overstated. This type of orienta- 
tion is importi^nt instrumentally as a..means to an end; it strengthens - 
the intensity of the program experience which in turn leads to job finding. 

■V 

An. important finding is that fears that job search assistance woul'd 
lead to worse jobs for participants than, youth who^shopped around longer 
for jobs'was' unjustified. The evidence in Cambridge is that the first . 
jobs found after job sear^ch assistance are modestly better jobs, although 
few^outh through the mechanism of JSA break 'out of the conventional youth 
labor market. Similarly, we find that the jobs found through i^ISA were* 
retained for longer periods of time. 

WeJeaVned a,lso that job search assistance works well *in the short 
run for a number of different groups. Dropouts, for example, were actually 
ove^nrolled in Cambridge, while employment outcomes 'in both communities 
did not favor high school graduates, dropouts, or in-school youth. An 
important finding fpV program operators is that no one group of youth 
stands dramatically outside the service possibility of JSA; welfare 
recipi'ents, males or female^, oyer 17 years or under, good and bad readers. 
We mi.ght note that family heads and -youth who lived independently of their- 
^parents were particularly good prospects for job search assistance (at 
least in Wtlkes-Barre). ^ . • 



There are several considerjtions in assessing the imnli cations of 
these findings. While the report is not aimed at the development of a 
national agenda for federally supported job search assistance (indeed) 

'one of the refreshing aspects of JSA is that it can be run without federal 
assistance by any number of local delivery agents), we would mention 
severaT noteworthy guidelines for policy. First, the-job search field .is 
in tremendous need of demystifi cation. The job search concept has been 

-embraced by many* in the employment and training community as a "quick fix" 
to unemployment* It has been moved in the welfare area, for example, 
frofh an employment transition service at the completion of training to a 
work test before provision of services' or in-kind benefits. Hopefully, 

.this report will defuse some of ^ the wildest claims for the effectiveness 
of job search assistance., claims often made by vendors of JSA curricula 
and consulting services. /Sfecpnd, '-while the research in this study has . 
been extensive, improvements could be cited. For example, we would have 
likkd to observe more closely the actDal job search process. Unfortunately, 
no one lias devised a way to unobtrusively study this subject directly. 
Third, we would have liked^to compare the costs ''of the programs to other 
JSA programs for, youth and adults*. Such data are not available in reliable 
form. Finally, we h^ive not answered the most important question of whether ' 
job search assistance is more or less ef/ective than* other youth interventions, 

such as conventional counseTing or. placement programs. The latter question 
will be the subject for further' research and syntheses aciross youth 
employment program projects. This study can be seen as the beginning of ' 
that effortj^by showing how and under what conditions Job search assist- . 
ance works for disadvantaged youth. 
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•Appendix A - The Local Context 

Appendix B - Impact Analysis Sample 
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Appendix D - Counselor Ratings of Participants' 
Employment Potential 

Appendix E - Research instruments and" Data Collection 
Procedures 

Appendtx F - Data for the Standard Assessment System (SAS) 
sponsored by the Department of Labor, 
Employment Tralntn^ Administration, Office 
of Youth Programs . 
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Appendix A 

Appendix /V contains a profile of the two local economies;; 
Wilkes-Barre, Pennsylvania and Cambridge, Massachusetts. This 
material should be useful background for understanding both the 
process and the impact analysis reported in Chapters III-IV. 
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Appendix^A ^ , . , . 

The Local Context 
The two sites are different in many significant ways, Cambridge, 
with a total population of 106,000 and a density of over, 16, 000 persons 
per squ^re\mile .(it's the third most densely populated city in the 
nation)>is famous as an academic center (Harvard University and MIT are 
the city's largest employers), but it has the same population mix and 
range of problems as other northern industrial cities. For three decades 
its manufacturingy industry has been migrating south, dramatically affect- 
ing the local labon market; Cambridge's stable population, is older, 
'poorer, and less eduWted than the average for the surrounding metropoli- 
tan area. Its largest\ ethnic groups are Portuguese and blacks; they com- 
prise. 11 and 10 percentVof the population respectively and a, dispropor- 
tionate share of families) 1 iving below the poverty level* About VPpef^^ 
cent of Cambridge youth, lo to 2l years, live in families below 'the pov- 
erty level. All these -groups were affected adversely by the loss of 
-manufacturing jobs, and the inicreasingly complex entrance requirements 
for the Service sector, ^ 

Despite these problems,'^Ca^nbridge's unemployment rate has remained^ , 
below the national average durjng the months, corresponding to the opera- 
tions of the Job Factory fbr iouth program (Figure l).''The yduth labor 
market in Cambridge, as measured by the unemploymerTl^ rate of 16-19 year 
olds, improved between 197Larjd 1979 (see Table A-1 ) by one percentage 
point. The. rate of jniprovemeni .was Igrea.ter than the aation a^s a whole 
and considerably better than ,Wil kes-Barre, where teenage unemplt)ymeiTt • 
^increased by 1.4 percentage points between 1978 and 1979, In the year 
of the demonstration projects, teenage unemployment in Cambridge was 



^ Local unemployment data are not cc^llected separately and are based on 1970 
'Census adjusted rates for regional trends. 
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lower than the II. S-. arid Wilkes-Barre rates. Averaging three years 
(1977 to 1979), the Cambridge youth unemployment rate was 13 percent, 
well below the nation's average of 16.5 and Wil kes-Barre's 21.6 per- 
cent. 

Luzerne County is located in northeast Pennsylvania and has a 
total population of 337,500 (Wil kes-Barre' s population is 55,969) with 
a density of 382 persons per square mile. Overall, 'the county popula- 
tion has declined 1.2 percent between 1970 and 1978. The city of 
Wilkes-Barre' s population decreased nearly 6 percent between 1970 and 
1978. The county's non-white population has increased from 1970 to 
1978; but stifl comprises less than 2 percent of the county population.- 
Unemployment and poverty are critical problems in Luzerne County. 
Nearly one out of every nine persons in the county live below federal 
povefty^-^SL^and^ Industries which 'once dominated the region no longer^ 
provide jobs. The coatTi^ once the^ deader among - . 

'county industries,' is currently last after^l^etrH-^ govern- 
ment, small manufacturing and other sectoj^s. The possibil ityoflT 
vitalized coal industry, in response to the national energy crisis, re- 
mains strong but to date has had only a marginal impact on employment. 

Many yogth in Luzerne County leave school early to seek employment 
outside the area. About 20 percent of poor youth* aged 1^6 to 21 leave 
school before graduating in contrast to 10 percent of non-poor youth.* \ 
higher percentage of Luzerne County youth are jointly out of school, not 

high school graduates, and not employed, than in Pennsylvania as a whole ^ 

* 

(5.5 and 4.7 percent respectively).' In sum, youth opportunities-in the 
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Wilkes-Barre area are constrained by the fact that it is' a small city 
surrounded by a rural county suffering from severe changes in the industrial , 
structure, out-migration, and a youth labor market that ranks unfavorably 
compared to the state and \i. S. population^ 



Un. Rate ^ 11 ;0 
(Unadjusted) 



10,0.. 



9.0 



8.Q— 



6.0-- 



^0 



Figuil 1 



^31- 



Quarterly (Unadjusted) Un e mploym e nt Rat e s 
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'79 



3rd 
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'79 
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Wilkes-Barre, Pa. 




United States 



1979«U.S. Unemploymen-t 5.8 ' . 
1979 Wilk^s-Barre 4Jnemploynient 9.1 
'1-979 Cambridge Unemployment 6.0 



pambridge, Ma. 



(Programs ■ ' • • . , ' • 

• Begin)' '• ..." • • , . ' 

Sources: U.S. Data: Employment & Training Report of the President - 1980 . G.'P.O. ,. .Washington, D.C., 1980. - 

O ^58 statrEm^'oJmen"se)vide°' '*^^^^'''" ""'^ ''^'""^"^ Report." (Hazletort) Pa. Area. Pennsylvania 

ERjC Cambridge Data:, , Bureau of La.bor Statistics, USDOL^ Region 1. , Personal Communication. 
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Table A-1 

Total and Youth Unemployment Rates 

Wllkes-Barre, Pa. 
U.S.A. ■ (Luzerne County) 



1978 — 

M) Total Unemployment Rate 6.0 

ft 

» 

2) 16 to 19 years ' 16.3 ' 

3) touth/total ratio 2.32 
(line,2 <1) 



8.7 
22.7 
2.61 



" Cambridge, Mass. 
(Boston SMSA) > . 



p. 6 
12.3 
1.86. 



1979 • 

4) Total Unemployment Rate 5.8 

^ . 5) 16 to 19 years 16.1 

6) , Youth/totar>atio 2.40 
(line 5^4) 

•„ 7) Estimated 1977-1979 Youth Un- 
employment Rate - ' 16.5 



9.1 
24.1 
2.64 

21.6 



6.0 



. 11.3 
1.88 



13.0 



^. Sources': See Figured - Estimated 1977-1979 youth unemployment rates are CPS averages adjusted for Census. 161 
160" • - ' 
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Appendix B 



• This appendix describes general characteristics, of the 
sample utilized in the impact analysis - Chapter IV. . 



\ 




^ Appendix B 

Impact Analysis Sample 



Demographic characteristics of the impact *sJt|nple are described 

* <% it , ' ■ 

in Table Ar2. Table A*3 compares the characteristics of first follow-up 

^respondents to' non- respondents. 

The total sample on which the present analyses, are Fased is- 764 
youth/ The parti ciDafit sample in Cambri^ae ms on the averaqe 18 years • 
of age'/ just one^year older on avera^je than in Wilkes-Barre. There were 
slightly more males in Cantridge but eou^^l numbers of females to males 

,in Wilkes-Barre. The Wilkes-Barre program ii situated in the Drejlominantly 
white community of Luzerne County, Pennsylvania. The Cambridge orogram 
enrolled signi/icantly greater numbers of black (36.5 percen^ and Hispanic 
youth (5.4 percent). In terms' of economic status, all youth meet CETA/YETP 
income eligibility guidelines. However., in Wilkeis-Barre, the ay.erage ^. 
family income of participants is higher t'hai^ in Cambridge. .;;M6re youth in^ 
Wilkes-Barre, for example*, are from families 71-'85. percent, and 85, percent 
or higher, than the'lowec liv.ing standards established by the Office of" 
Manarjeifient Budget and .DHL. ^Iso, in Cambridge,' double the number of pro- 
gram participants receivfe pubTid assistance (27.6 percent) ^thaj^ in* Wilkes- 
Barre. And, one'third of the Cambridge youth' head their own households ^or 

. live apart from their parents' homes. The comparable figure in Wilkes-- 

Barrels Il.9i^^rcent. hlost youth in both communities, have some previous 

work experience and'^*ust over a quarter of the youth have been involved in 

CETA programs in. the past. (Wilkes-Barre is ^ community program that re- • 

ceives YEDPA funds bat "competes" for law income youth with the local CETA 

agency.) Overall, the^Cambridqe experiment apd control prouns are. similar 

« * 

in the ma.idr demographic characterisitds displayed ^*n Tat^e A-2. 
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The preceding is a statistical -profile of the samples. Jo awe the reader 
a better "feel" for the job search assistance^ partT'cioan^S', Appendix C 
presents"'qualitative profiles^ ' ' i-t. o 



Table A-2 

J' ' 

Sample Descriotion by Demc^&faDhtc Characteristics 



/N of Participants: 

Age: X- years , 
* ^ Percent 16r17 
Percent'' 18-21 
f 



Sex: ^ 
Race:* 



Ma Tie 

Female, 
• 

WhUe • 
Black 
Hispanic 
Other 



Cambn'dg'e 

Experiment 

203- - 

18^3 • 
19.2 
,80.8 ^ 

54.7- 
: 45. *3 

40.4 
36,5 

8.4 , 

6.3 ' 



\ 



Family Status:* , ' - . 

■ Family Head' 4.4 

"Family Member • 55.2 

Indepen. M6mber 28.1 

Education. Status :* 

. H.S. Student / 

M.S'.' leaver . 31.5 
H.S. Graduate ^ 55.0- 

Ex-Offender Status: 

Prior Records 9.4 

f^ubiic -Assistance: 

AFDS, SS,.Otlier 22.7 

Previous CElA-Experience: 

• . Yes . . ?6.6 

Previous Work Experience: 

N' Yes,. • " 82.3 

Economic Status:* 

. 70% Lov/er .Living '> 

. . Standard • -52.0 
71 -85^ower Living ■ ' 

■ . Standard - • -15.3 • 

86% - MJre . ' 3.4 . 

■ * Other ) - .' ■ .1.0 



Control 

•165 * 

18.7 
13.3 
86.7 

63.0 
37.0 

44.2 
37.6 
10.9 
4. a 



4.8 
50.3 
33.9 



37.0 
,48.4 



8.2 
26*1 
25.5 
9a. 3 

44.0. 

8.6 
' 2.4. 
■T.8 



Wilkes-Barre 



396 

17.2 
39.6 
60.4 

49.5 
50.5 

97.2 
2.8 



5. '6 
68.2 
6.3 



■ 43.7- 
8\3 ' 
19.9. 

13 '. 5- ■ 



11.6 
31.1 
60.4 

37.0 

16.0 
16.0 
2.2 



*Per'centages do no%-,add to, lOO-^percentt ' Missing category excluded. 



Table A-3 



Characteristics of First" Follow-up Respondents 
• and fjon- Respondents 











(Per cents) ^ 
























Cambridge . 




Wi Ikes-Ba rre 






Exp.. 




Control 








R 


NR 






R 




piaie 


51.5 


60.3 


40.7 . 


32.9 


'53.9 


48.1 


Age: 


22 3 




* * 










11 


3.5 




37.0 


41.6 


Dropout 


30.8 


32.9 


29.1 


4R fi ' 


6.1 


ia.o 


H.S. 












• 


Grd. 










25.5 


25.1 


Prev. 


34.9 












CE'TA ' 


39.5 


34.7 




< 

43.1 ■ 


56.9 


r rev* 


84.6 








• 




Work 


79.5 


94.2 


60.0 


61.0 


Pub. 


5.4 












Asst. 


5.5 


114 


7.6 


5.5 


7.4 


Fami ly 


• 












Head or 


26.2 












Non-Dep. 


43.8. 


29.1 


• 49.4 


9.7 


13.4 



Table A-3 compares characteristics of youth who returned the first follow-UD 
and those that did not respond to the first follijw-up^' In Wilkes- Barrel 
the.group of non- respondents are quite^ similar to follow-4ip respondents. ' 
Among the tr'eatment youth in Canbridge, non- respondents are more likely to 
be male, 18 years or older, and separated from £he^r parents' homes. Within 
the control group, the notable differences include the followinq: non- 
respondents are more likely to be females, dropouts, have no previous CETA 
experience, and, he#4»^their own households. 



/"' 
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Appendix C ' ■ 

Job Factory for Youth: Client Profiles 

The following are selected profiles of some clients in the first 

s 

three cycles of the Cambridge Job Factory. ^ They were recorded by the 
participant obsrerver and are deliberately impressionistic. Names have 
been chancfl^and events rearranged to ensure confidentiality. Their purpose 
Is to provide insight into the personal factor, »as a counterpoint to the 
analytical and statistical data. The profiles selected for presentations 
give a flavor for the clients served by the Cambridge job search assistance 
program; they are, however, not a "representative sample in a statistical sense 

Mary had graduated from a local parochial school. Her only prior work. 

experience had been^art-time Vs a receptionist and kitchen aide during the 

last four years in a l9cal thuroii rectory. Mary was constantly referred. to 

as "the model Job facVbry client," and -she secured a job at a large insur- * 

ance' company ,as a statistical analyst by the end of the second week of the 

program. Sfjp was also offered another job during the same week as a teller 

trainee at a bank, which she turned down. She was recommended to the bank 

by a program counselor after learning of the vacancy on her own,.arKl was 

referred to the insurance comf5any by her sister, «n employee* of that company. 

* 

Hormitas , a Haitian living in Boston with relatives, missed much of the 

the first week of the program because o*" academic commitroents at the high 
school. He also worked the graveyard shift at a local fast food restaurant 
as a cook throuc^ his senior "year and during the program. Seem- 
ingly financially independent;, he had little regard for the structure 
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of the program. . He was terminated during the last wee^ of the program. 
At the follow-up interview; he claimed to be working at a s'tate hospital 
as a housekeeper. 

4 - 

Katie , ! the youngest child in a large family, attends a New England state ^ 
univeriity, and plans to major in social service administration. Katie 
is a real achiever— a member of the National Honor Society, varsity 
^athlete (tennis and swimming), industrious. She hawked newspapers for 
• five summers and throughout the 1978-79 school year. She also has been* 
a life guard at local pool during 1978. She secured a job at a YWCA 
pool for the summer after a' self-directed telephone search of the Boston 
area. 

«» 

■ J> ' ' • 

Grace is a Haitian gfrl recently graduated 'from h^gh school. Though she 

spoke very 1 itifle English, she was fiercely determined to do all that 

was expected of her, insisting on completing all the research question- 

naires without assistance. She secured a job at a manufacturing company 

adjacent to the Job, Factory buildirvg as an assembler at $3*08 an hour. 

She got a tip from another Job Factory client who was also hired there. 

* She presently lives in Boston with her cousin. 

Contessa , white female, eager and ambitious, but unfocused, became 
very dependent on the program staff. As the program progressed, she 
consulted staff heavily at every stage for everything. She completed 
the program without placement. She enrolled in SYEP after the 'Job Factory. 
She is presently attending a community college and is looking for a 
part-time job. ^ * - * 



Tony is a Haitian male who excused himself for his extreme tardiness 
the first day with promises that it would never happen again; the 
promise proved hollow. He is /trilingual and is an experienced martial 
arts instructor. He is also /an accomplished song writer and guitar 
player who in his resume describes himself (as in very good health'with 
a positive attitude toward life and work. He has worked as a fast -foads 
cook*s aide part-time for two years in a restaurant, and as a counselor- 
in-training at the YMCA during a summer. When^contacted after the pro- 
gram, we learned from his family and friends that he was sick and in a 
hospital in New York, Jony contacted the r^earchers in December for 
the second wave follow-up, and claimed that he was a student at a local 
univers^ity, and was working in the psychology department. 

Ray , one of only three white males in the first Job Factory cycle, £s- 
tab! 1 shed. good rapport with one of the counselors but related little with 
other peers in the program. Though he* had various , job interviews during 
the four weeks of the program, he finished without placement. Onsfollow- 
up in August he was in basic training with the U.S. Navy in Florida. 

Harold , a tacittirn, young black man, stated on the first day of the pro^ 
gram he wanted a job where he would not get his hands dirty. He is pres- 
ently attending a local university. His work experience includes three 

f 

months as a stock boy a?t a travel agency, month of Upward Bound, and 
a summer- with SYEP as a gym instructor. Also, he had worked part-time'^Yive 
months washing cars. He kept a low profile during much ot his 'time in the 
Job Factory, generally doing what was ex|iected of him. He did not, however, 
pursue a' job wcith any ardor. He quit the program after the third week. 

4 

« • 
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Later, he participated In an Upward Bound Program. 

Etlen, an 18-year old H.S. graduate, secured a job at« the end of the, 
- second week of the program as a teller trainee at a locaV-bank. She 
Had heard from a friend that they were hiring and set up an interview 
on the phofie. Her pl-ans are to continue at her p/esent position. 
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James is a young black man who stayed in the program for three weeks 
•before being dismissed. He made only a minimum effort at job search. 

He was referred to the Job Factory from another public program where 

f 

he, had worked six months doing home rehabilitation. 

/ 

Lee Ann , a 20-year old white woman, is a high school graduate with 
severe emotional problems. She had no work history. She was terminated 
during the second week of the .program for her repeated flute playing 
during work sessions. She was totally incapable of any sustained work 
and presented an unustml problem for the Factory staff because of her'' - 
bizarre behavior. • 

* • 

Robert is a 21-year old white man with a high school diploma. With 
some prodding, he was motivated in his early j^b search^ to compl^etfe an 
acceptable resume. However, he soon became easily discouraged, com- 
plaining incessantly of nervousness. He was terminated at the end of 
the first weak. His work history includes one brief stint with a loca> 
company as a truck loader and a summer job as factory worker. ^ * 

A ■ 



-141- 



Betty is a 21-year old bilingual (in English and Portuguese) woman with 
her G.E.D. She worked diligently to find a job as a receptionist/sec- 
retary wjth a real estate company, only to find herself out of work"When 
her new boss hired his girlfriend. She ijnmediately found a position as 
a receptionist at a tax Consulting firm, and credits the Job Factory 
with her fine resume and good advice. She has a three-year work history 
in the clerical field'. 



Caesar is a 22-year old white man with an admitted alcohol problem. 

» 

He has three years experience as a chef trainee at a Targe Boston hotel. 
He fi^|||khed the program without placement. Caesar was capable of dili- 
gent and cooperative job search, but was unable to sustain it. He finall 
admitted to staff that he had a drinking problem that was interfering 
with his work. 

* Cecil e , an 18-year old bilingual 'fiispanic wpm^in; found a job over the - 

phone. aS a file clerk for a credit agency, beginning at $3,50 an hour. 
, • She had worked as a receptionist in a hospital (one year). Cecile did 
not graduate from high school. 

Janice is a twenty-one year old woman with a tenth grade education. 
She is. presently separated from her hu§band, has two small children, 
and lives with her grandparents. She last attended ischool in February, 
1976, though she is currently taking night classes for the GEO. Her 
work experience includes two stints as a machine operator in garment 
factories. From August 1977 to October 1979, she worked for a dress 
manufacturing company at $3,15 aa hour, and from October 1976 to Decem- 
ber 1 976, she worked for a fabric firm. She left the latter employer 
because of "ppor working conditiDns." She was an enthusiastic and 
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dill gent* member of her JSA class. .She initially listed her ideal .job 
as a computer operator but after seeking information r^^rding this 
choice, sl^e switched and pursued a job in a bank. A week after search- 
ing, Janice got a job as a teller trainee at a large commercial bank. 
She attributed her success to her high score on a standardi^d "ir\tel-" 
ngence" test. She expressed satisfaction with her new position* 

Robert is a 22-year old white male with a tenth-grade education.- He 

V 

• listed his most recent employer as the U,S, Marine Corps^'Prior to ^ 
entry into the service, he worked for $3J5 an hour at a large department 
store* He stated that his reason for leaving was a criminal conviction 

* on a breaking and entering charge for which he went to jaiK Prior to 
that, he worJced in the maintenance department of a large company Tor 

, $3.50 an hour. 

*^ >, • 

Peter was a regular participant in his JSA clerss and wished to find a 
job as a furniture mover. After a week of* active searching, (he visited 
^5-6 moving^cdmpanies) he landed a job with a furniture company in 
Cambridge. At the first follow-up period, we were unable to reach Peter. 
His mother informed us' that he had gotten a place of his own and had no 
phone. In the summer^ a researcher' happened to see Peter on a street in 
Cambridge. He said that he^ was no longer working at the furniture storel 
he had been arrested again for breaking and entering and would probably' 
be 9oing back to ja,il . 

Cecil ia is a 19-year -old, unmarried Hispanic girl with a young child. 

a 

Her mother took care of her chiljd while Cecilia regularly attended Job 
Factory. Cecilia wanted to get a job in day care. After a week^of 
searching^ she- landed a job as a teacher's aide in/i suburban Head Start 

' i 

' Program. 

_^ ^ ^ 17 1 



Aaron is a twenty-year old black man. His participatlo.n was errai 
and he was terminated at the end Jrf the second week of the program. His 
previous ^work history is very spotty; he listed hav-ing a "minor break- 
down** as a reason for leaving his last job as a laborer. At the first 
follow-up, he was unemployed. 

m 

Peggy is a self-supporting twenty-one year old white woman with an 
Associate Degree who hoped to break fnto the communication/personnel 
field. She had been working part-time as a waitress, hoping to save 
enough money to return to college and to travel. She was an active ^ 
member of her Job Factory class, continually offering support and ideas 
to others. After the formal classroom training, she pursued a number 
of informational interviews at such places as local newspapers, radio 
stationls, and colleges. Finally, she accepted a position as an admissions 
secretary at a college in Boston. ^ 

Mel is a twenty-year old* black man who has completed one year on a 
football scholarship at a large southwestern university. He has returned 
home because of "^p^rsonal" problems. He expressed interest in returning 
to college to. pursue his education and what he hopes will be a career 
in professional football.' He would always appear at the Job Factory 
well-dressed, but his attendance was erratic. According to h-is sign 
in/out sheet, he sought work at an insurance office, hospital, a;^bank 
and several retail, stores. He was offered and accepted a position .as a 
messenger at a finance company. 
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Saj[||a is •22-year oTd high*school drop out, who has been unemployed since 
Spring, 1979. She found a job as an asserai^ler on a cold call. She 
has two years of bartending and waitressing experience in a small bar, 

Fred is a recent honbrs graduate from a rural high school where he ex- 
celled in sports and academics. He has had three unskilled jobs during 
previous summers,. • He landed a job as a researcher>at a service company 
on ehcpld call the third week of the program. 



Lenny is a 20-y^a)^ld high school dron^ut. He claimed that he had 
been recently dishonora^Hcdischarged from the. l),S, Marine Corps for 



stealing an" officer's jeep. He^had no other work history of note. In 
contrast to his alleged escapades in the service, he presented himself 
as a diligent and competent individual intent on finding a good job. 
Initially he wanted t;o find work in hotll management. He secured two 
interviews ajt local hotels. He final ly^accepted a position as a printer's 

- I? - 

assistant at $4.00 an hour at a printing company in downtown Boston. 

Our one-month follow-up revealed that he had been promoted and was now - 
making $4.75 an hour. ) 
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_ ^ Appendix D ^ 
Counselor Ratings of Participants' Employment Potential 

i 

In this 'Appendix, we consider an Important topic, but one that is 
ancillary to the major themes presented in the 'process and' impact 
analyses. The topic Is the job search assistance counselors' assess- 
ment- of participants. Our interest in. counselor ratings of clients' 

, • V • . 

employment potential stems from two concerns. First, -the JSA-programs 
attract a relatively homogeneous, group of low income volunteers (see 
Table A-2). .We would like to know how the counselors differentiate 
among the participants in terms of the youths' readiness to work. The 
counselbrs are, in a sense, much like the pO'tentlal employers that youth 
|)ope to Impress., Therefore, the counselors' judgments are important 
trial balloons of the real world-of-work. Second, the variability in " 
counselor ratings may be related in soiqe .way to post-program outcomes. 
Considerr^or example, whether counselorl who pergelve their young 
cllehts as suffering from many disadvantages and "employment barriers 
treat these^youth differently. Perhaps yout+i wh« are. perce'lved as more 
disadvantaged are overlooked for- intensive supported job search thro'ugh 
a "creaming" process. Alternatively, such youth could be, selected for 
special treatment. .Botb possi biltties may lead to unique outcomes. We 
have no direct evidence of such phenomena, but through two survey instru- 
"ments -we -can explore some of these ideas. • ■ 

» 

Two instruments were utilized in this study to assess counselor 

" ' * 

ratings o+ participants. The first, called Summary Rating, was provided 

* ^ » 
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as .part of the ETS/SAS sys^.. It asks }7 questions about each partic 

ipant^s attitude and program experience; about whether the participant 

pays attention to grooming and~dress;'is open about discussing job 

problems; shows resentment and hpsfiTify; ^nakes realistic plans, and 

is coherent in" expressing him/herself . The. other instrunjerit was developed 

by the reseeirchers and has been used successfully* in ^ number Df eval- 

t » 

nations -of welfare recipients. THis' "Barrier** fofm asks counselors, to 
rate the youths in terms of barriers to getting or keeping a job / The 
14 barriers may be grouped into four categories: educational (e.g., 
reading, writing, di fficulties , -tiot enough educatign); medlcal.-psycho- 
logical (e^.g., handicaps, alcoholism, drug abuse, Jens^V nervous);, 
socfal service barriers (e.g., child care, transportation problems)^; 
-an(l, direct employment barriers (6.g^,y acks job experience, references, 
specialized skills).. 

Table A-A'^shows the percentages of youth viewed as having par- 
ticular categories of employment-related barriers as well as the re- 
lationship between the counselor views on barriers and the summary 
counselor ratings. The most prominent type of 'barrier is the direct 
employment type'f&.g., lack of references and specfialized skills). !n 
both communities^, between 60 and 66 percent of all JSA youth are labeled . 
by^counselors as experiencing this barrier. About one-third, of youth * 
in both commJfiities have educational^^barriers, and just over a quarter 
of the youth in both programs have- psychological -medical ban^iers. The 
counselors' assessments are similar across communities with the exception 
of the social service barrier. In Wil kes-Barr.e, transportation problem 



account_for- more youth" haying th.is latAer barrier than in Cambridge. 

As expected. Table A-4 shows'tJJat youth who are not' designated' 
as having do parti ciflar barrier receive higher .scores on the Ef^/SAS 
Summary Counselor* Ratings, the variabil ity^of the ETS/SAS counselor 
ratings .-'however, is rather narrow when comparing among youth with — 
barriers or between yout^"with barriers and no- barriers. Most youth 
ar^ rated low on Sunmary Counselor Rating*. 

Next, we consider whether the employment barriers are related to 
job finding in the post-program period. Table A-5 shows the following: 
In Cambridge," youth with the medical -psychological and direct employment 
barrier's actually work in greater proportions than those without -such bar- 
riers-. On the other hand, those with educational barriers work less than 
youth without such barriers. Apparently, tihe latter educatlonrl barrier is 
a greater detriment 'to employment than lack of work experience or healtli- 
related problem?. In Wil kes-Barre, jn^each case having a barrier leads 
to less employment, except for the soc>al service barrier, where the — 
effect is reversed. ' 

Ta learn whether 'job finding 'differences persist between youth with 

.barriers and those without barriers after other variables, such-as age^'sex, 
reading level, education status, ethnicity, family status and weffare status 

*ape introduced, we performed a number of regressions involving the various 
employment-related barriers^ The pattern of job finding holds regardless 
of empT^yment barriers. None of the regressions- resul ted in significant 
barr1eP»eoeff1cients, with the exception of a Cambridge rafression involving 
the educational barrier. (There, "youth who do not have the education 
barrier were found to obtain higher rates of job, finding, 

176 . . 
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Table A-4 . ' ■ 
Employment Barriers and Counselors' Ratings 
Percent of Yojjth -Having Empl oynji^nt^Rel at ed' Barriers i 





Cambridge (N = 93) ^ "4 
Wilkes-Barre (N = 195) 10 



Social Service Psych^Medical Educational Direct Employmen 



29^ 
11 



37 



33- 



66 > 

* 

62 



The Relationship Between Employment Barriers and Counselor Ratings - ' * 

Mean Scores> on Counselor Rating * - ' 

Social Service Psych- Medical Educational Direct Employmer 
No ^ No Flo" No 

' Parrier Bar. Barrier B«ir. Barrier ^ir . Barrier Bar. 



Cambridge (N = 93) - 3.5 -3.6 . 2.9 
Wilkes-Barre- (N = 195) 3.3 3.9 3.3 



3.9 3.3- 3.8 3.4 4.0 



4.'0 3.3 4.1 3.5 4.3 
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,Job Finding. aod Empltfyment^Bianf^rfers in Percent's (Number) 



Wilkes-Parr'e 

Percent of Persons .with^ t 
Barrier M^tia Work at 
Is-t FolloW-up . 

Percent of Persons without 
Barrier Whp Work at 
Irt Follbw-up 

Calnbritiqe ^ ^ ^ 

Percent' of persons With 
Barriers \tkf> ifcrk at , 
1st Follow-up 

Percent -of Persons wi^thout 
Barriers Who WorJc at ^ ■ * 
1st Follow-up % ' 

t T ' /' * 



^ ■ 



Soda! 
Service 



, 75.0 
(20) 



68.0 
(100) 




J2) 



65'. 4 
(-104) 



Medical- 

Psychological Educational 



61.8 
(34) 



' 72.1 
.(86) 



67.9 

(81) 



52:0 
(25) ■ 



60.0 

(35), 



72.^ 

(85) 



46.7 

^30) 



.71.1 
(76) 



Direct 
Empi oyment 



• 63.2 
(68) \ 



76./9 
(52) 



72.5 
(51) 



56.4 

(55) 



fit 
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ceteris paribus ,) This finding is cons;1stent with the, data^, described above ^ 
.for Table A-§.) Similarly., we tried r-egressions with the ETS/SAS counselor 
rating variable as an independent variable on the job finding dependent 



variable (at firS^tj^ol low-up). In Wilkes-Barrfej counselor rating was 
significant ^e^Table A-6)/ In Cambridge, the ETS/S'AS counselor rating 
scale was no^ignificant. • * ^ . " ^ • 

* To summarize, the results show that in Xam^idge there is no'simple* 
relationship between counselors' designations of the Various employment 
barriers and subsequent jQb finding. In fact, when various background ^ 
characteristics are Introduced, the employment barriers are diminished to 
insignifiicance (with the exception of education barrier in Cambridge)^ In 
WilkesrBarre, the overall counselor ratfng scale is significantly related 
to job finding,* S'fter the various controls are introduced J ^ 
The data on counselor ratings suggest that although an important feature 
of job search assistance may be the way counselors perceive young clients, . 
the counselor assessments— both with respect to employment barriers and 
overall ratings— are not completely reliable guides to the subsequent employ- • 
ment success of youth in the labor market. In job search assistance, ' 

•counselors may be able to quickly assess a young person's strengths and 
weaknesses, employment barriers and advantages. It cannot be said, however, 
that the counselors know best which youth will succeed and which will fail 
bjefore the youth leave the. program. Moreover, there is no evidence in our 
data* of discrimination of one sort or another by the. counselors. Youths 
with employment barriers, fq>^ example,, are not disproportionately minorities, 

^dropouts, or th^ like. Finally, the most reliable^ide to success appears 
to be the education-related employment* barrier, • 

^We investigated several explarrations fDr the finding that Summary^ Do un! el or 
Ratings fn the Wilkes-B&rre program are significant in job finding. Wene 

. the ratings, for example ,^related to hours spent in the program or the' ^ 
background characteristic^ of the youth?, We could find nonsignificant • 
differences along these dimensions.' . • . 



The Effect' of CounselDr Ratfng on Job Finding - Wilkes-Barre 
' (First Follow-up) 



Independent Variables 

% ' - * 

Counsel oV* Rating Score (ET^S/SAS) 

Erfucation 'Status: Dropout 

High School Gradujite 

Sex: J^emale 

Age: 16 or 17 

Reading Level 

Famf^ status^ Head or Non-dependent 

Public Assistance ' 

- * 

Group '2 ' • ' 

Gryup ^\ . 

Constant 



Regression 

.1606*' 
(.0594) 

r.0753 
(.1103) 

.1390 
, (.1103) 

-.1372 
(.0957) 

-.0874 ' 
(.0971 ), 

/ 

-.0012 
(.0008) 



.2454 
(.1425) 

.2879 
(.3244) 

-.0590 
(..1028) 

•,,0164 
(.1090V 

.1270 



. ,• ■ 

N (Listwise deletion) 



108 ' 
2.31* 



*Signfficai<catiori at .05 percent level (2 tail test for independent variables), 
'^For variable. definitions see Chapter IV. 
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Appendix E 



This appendix describes the research instruments and data 
collection procedures utilized in the e\/atuation. 

• ■ ■ , V • ■ ■ 
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. • Appendix E , 

Research Instruments \ ' • 

Listed belowi^e the research instrumejits used .ih the study. 
All, except for the STEP. Reading Scal£ and the battery of seven p're- 
-post-tests-ppga/iized-by the-iducationa-VTesting-Ser (ETS) for use 
by researchers in a Department of Labor supported national data* bank, 
were developed or modified by the researchers, fgr this project, (See 
Rock & Freeberg, 1980, cited in Chapter 2 for a detailed account of the 
measures used and information pertaining to the ETS/Standard Assessment 
System, ' 

1* Individual Participant Profile (IPP) — includes enrDllee * 
characteristics; program status, and termination status. The 
' IPP Was given to all youth in the study, ' 

2. STEP -Reading Scale*-- a short -10-15 minute measure. of reading 
level hanging from fourt.h to ninth grades. 'The STEP is" actually 

' a composite of items frofi several loc^itor tests desigfteid tb 
' assess xjuickly which level of a full reading test is appropriate 
^for a -given student. The STEP was given to all study youth, ^ 

3. Pre- and Post* Psychometric Tests — These include seven relatively 
. -short tests, th'e tests were described in Chapter IV. 

4. Program Completion, Survey (PCS) — an exit questionnaire to de- 
.termine what youth did in the program, attitudes toward the pro- 
gram, aspirations and expectation9--was given to treatment youth 
in Cambridge and all youth in Wil kes-Barre. . 
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5.' Counselor Rating Form ~ this form is filled out by the JSA 
counselors and asks them to assess individual participant 
youth in terms of the youth's attitudes and overall likelihood 
of success in the labor market. 
* 6. Employer Rating Form- ~ This is a short questionnaire given /, 

V 

to employers who hired JSA participants. The response rate 
wa§ too low to reliably report results in this study; the , 
sample of employers was -limited to youth and firms who con- 
sented to its administration. • 

7. Employment Barrier Forms This fo»nii was developed by the 

. researchers and used to assess the JSA counselors' opinions 
vas to employment- related barriers of individual (Clients. 

8. FolTow**up Surveys— these personal, phone and mail surveys 
were given to all^youth, treatment and contro.l. They record 
labor force participation and a range 'of other post-program 
experiences. 

9. Wilkes-Barre- Comparison Group ~ Brandeis .obtained a list of 
approximately 125* positive and negative termjnees from the 
Wi\kes-Barre CETA prpgram *(Title,II-fr and YETP). ^The same follow- 
up survey^ as in #8 were^'used- Tracking CETA youth in ^ 

^ ** Wilkes-Barre proved ^very difficult and began too lateXn the 
study, to obtain reliable results. Thev are not reported-. " 

10. Program appl i cations,- were examiiied for. research purposes. ' 

. . ' ^ ' • • . \ ' ' *• 

11. Program records, such as sign-up sheets,, attendance records, 
pro^res^ reports, and^budget reports ^ were examined^ for r^- . 
search purposes. „ ^ ' - * 
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12/ ETS/SAS Progfam Information Questionnaire and Brandeis open- 
ended program operati5<;^qu6stionnaires were used, especially 
for the prficess study. , ' * 
' , Data Collection ' * / ^ 

ColTfection of data for the process and impact studies was 
the main responsibility of the researchers in coordination with the 
program agentj in each of the sftes. Data collection' arrangements 
varied between the two program sites^due to differences in program 
design and geographic location. In Cambridge, because of its.pro'x- 
imity to Brandeis University (10 miles), a*"' staff .member from the 
evaluation* team was assigned as a participant-observer to each cycle 
of The Job Factory. He was* responsible for monitoring the testing 
activities of the experimental i^group, -wi^h the assistance of program 
.staff members when necessary. Brandeis researchers conducted the 
follow-up surveys." The first fol low-uf?. was geijerally a personal in-' 
tef*view; a coRlbination of personaVand|tel^phbne. irtferviews were ^ 
used for remaining follow-up surveys.* ...... 

• Wi^h the exception of the fallow-up instrument, testing ') 
activ4ties 'in. Wilkes-Bar)*^ were supervised by the researchers but . 



administered by the program couiTselors. In an effort to^gather accurate 

follow-up information from participant yout^i, a research field agent 

*' ■ < ■ 

*was hired and trained J>y the Brandeis evalu|ition staff- to conduct per-^ 
sonal (Tst follow-up)* and telephone folT6w-up^ (remaining three follow- 
ups) interviews. • ' . ; / - * 

The^sequence of follow-up data 'gathering was not consistent 
across sites. In Wilkes-Barre, youth were regarded as ^ioprttci pants 
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for up to three months after program entry, unless they terminated 

positively for jobs. Brandeis received .the names of both categories- .. 

of youth and interviewed them six weeks after they obtained jobs or 

six weeks after they left the' active list. Therefore, With the ex- 

caption of early job finders,; th^^iftrst follpw-up survey in Wilkes- 

Barre could take place ^lip to 3 month's plus 1% months — 4% months 

after program entry. The information collected, however, was retro- 
" * ^ • / * . ' . . 

spect'ive to program exit. The Cambridge administration of follow-up 

instruments was more uniform since the program was divided into s6pa- ^ 

rate cycles. Table Ar7 below illustrates the actual timing of research 

'instruments. Note that in Wil.kes-Ba^n^, the averg^ge time from program 

antrvto the first follow-up ts 24 weeks in contrast to the 10 'weeks 

irv Cambridge. Table A- 8 shows the planned administration of research 

instruments. ^ Table A-9 shows the number of respondents for each cate- 



gory^f 'research instruments. . 
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\ ' Table A-'7 . • ' ' • 

"Research Instrument Administration ^ ^ 

* (Mean Weeks) 

Cambridge • Cycle Cycl/ Cycle Cycle 

: . I II III JV 



j^£x|ier1mentals: 

ybgrani Entry to First Follow-up ro.57 " * 9.36. 12.93,. 11.00 

'Controls: . . ; . ■ * • • . • 

Assignment to First Fbllow-up 11.06 . 9.32 11.78 10.88 

'#T1ii|ie Between fir^t and Second Follow-up 

xperimerrtal : 17.25 • 14.51 12.22 N/A 

(tontrol: 19.42 17.13 13.75 N/A 

J Title Between Second -and Third Follow-up 

. i:xperimental : • 12.59 9.05 N/A ' N/A 

(tontrol: . • 11.96 7.08. N/A N/A' 

Tiiie Between Third and Fourth FoT-low-up ' • ^ ' . 

ilxpeirlmental : . • 8.83 "8.66 , N/A^ N/A 

Control: 8.26 9.55 N/A N/A' 



Wi 



kesrBarre Group Group .Group 

I II III 

• * ■ 

Tirie Between Program Entry and, 

hrogram CompT-etion • 10.69 8.20^^ 9.41 



* Tine..Bfttween Program Entry and 
^irst Follow-up ' ' 

^ 



P, ' ' 26.04 21.78 . 24.74 
' T'liie Between First ancj Second 

^ pollowi-ups 14.14 14.41 14.24 

Tiiie Between Se'cond and Third 

•ollow-ups- • 10.36 8.60 8.68 
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, Table A- 8 

Planned Testing Schedule for the Job* Factory and the 'Workshop Programs 



Cant)ridne ^ Cycles^-5- 



IPP Pre-Test 



STEP 



Post 
Test 



PCS 



Job Factory 
Participant 
GroQp 



' Jpb Factory 
r'^Cfintf ol 
•-"^firoup 



Wilkes -Bar re': 
Participant 
Groups • ; 



Enrollment 



Enrollment 



\ 

Enrollment. 



* 3rd day 
In p^ogr^am * 



Time 
of 1st 
Fol-up 



3rd day 
in 

Program 



3rd 
day 



Time 
of Tst* 
. Fol-up 



3rd day 

-in 

Program 



Program 
\fxit 



Program- 
Exit', 



Program 



-ftr-Gcir-am 



Exit 
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Cycles Cycles Cycles 
1-3 1-2 1-2' 


1st 
^FpV 
(iP ^ 


2nd 3rd ' -4th ^ 
Fol-' • Fol- Fol- * 

up UP UD 


6 weeks , 
after 

Exit 


14 weeks 

lifter 

1st 

Fol-up, 


^ weeks ^ 
after . 
2nd 

Fol-up 


b Weeks 
after : , 
.3rd . . 
Fol-up 


6 weeks . 
after/^ 
Program 
Exit 


14 weeks 
^ . after 
* 1st 
Fol-up ' 


& weeks , 

after 

2nd 

Fol-up 


, 8 weeks 
after ^ 
3rd ^ ' 
Fol-up 


'6 weeks 
after 
Program 
Exit . 


14 weeks 
after 
-1st 
Fol-up' 


8 weeks 
after 
Rnd - 
Fol-up 


8 weeks ^ 
after 
3rd-^ 
Fol-up 



188- 



Table A-9 

Respondents 
(Numbers) 



Cambridge; 



IPP 

•Pr^-test Only. 
Post-test Only - 
Matched Pre & Post Test • 
First Follo.w-up 
Second Follow-up 
Third fb^low-up 
Fourth Follow-up 
PCS Survey >• 
STEP Tes't 

Control ^Pre-test? : 
and . First Foillqw- up 

Pre- Pos t. Firs t Fo 1 - up 

•PC Survey," First *Fol-up 



EXP. 


CONTROL 


203 


165' 


*62 


. - 66 


13 


fl/A 


.1 06" 


N/A 


129 


86 


83 . 


-56- 


58 


41 


53 


33 


155 


- - N/A 


168 


67 


N/A 


64 

1 




N/A ' 


106 / 


N/A 



Wilkes-Barre / Total 



0 



396 
132 
6 

224 

164 

117 

_69 

N/A 

271 

365 

m 

125 
120 



764 
260 
19 

-330 
379 
256 

■i-68_ 
.86 
426 
600 

64 
196 
226 



, -160- 

..AppenHix F 
Supplemental Analysis Tables 



The Dep^ctment of Labor, through a contractor, the Educational 
Testing Service, has sought to standardize program assessment activities 
funded under the 1977 amendment to CETA entitled the Youth Employment 
^ Demonstration Projects Act (YEDPA). -The goal of the' Standard Assessment 
^ ^ System (SAS) is. to^establish a common data base for variety of programs ^ 

and to encourage generalizations across programjs. The ETS/SAS system 
' ' described in the text is both a set of research instruments (see 

Appendix E) and a set of common anatysis'tables. ^ The latter are presented 
in this Append! X. , ' \ , . ^ 

It should be .noted that other analyses suggested by the ETS/SAS- 
system appear in the text of this report, v Appendix F therefore provides 
additional material. Much of the material In Appendix F involves dis- 
•aggregated data with rather small cell sizes. Extreme caution -should 
• be appHed in ^aw4ng inferences from th.ese data. Another limitation 
'Stems frcxn the^act that the two job search programs were funded before, 
the start of, the ETS/SAS and tfrerefore the present research was not 

• ■ ■ • . • . ■ ' • ; 

structured to correspond perfgctl ^toj ts requirements. The most notable 
example 'is the failure to post-test control groups-youth inXambridge (see' " 
Chapterj^fV-Section C;for details) on a v'ariety'bf t^ests. Another reason, 
for ta'ution in- reading -these t.abVes.is that many tabtbs«pi^esent simpTe 
, >■ two '"iaH able 're1ati-dnsh'tt>s and *do"' no°t -control for o^her variable's. The., •« 

«. ; mult-i pi e^ regression procedures in the;te)ft of the report do, 6owever, trV 

• .to ^trol /or '-the effects of -several explanatory variables. We-, halve, inter-. 

^pre ted 'stele. 6't the "tai^les flP>-'this;Append<x^hatn hiV^^oj:e^8rtfjy -fl^ing^^^^^ \ - ' 

ERIC , \ ; . . ^ ^ 
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Guide to Appendix F Tables ' " . 

Appendix F tables are clustBred in three categories- Shawn belovf. 

1) Attitude/Knowledge Areas Tables 
Table A-10 Split Halve% Reliability • 
♦Ta'ble.Aj-n and Wil kes-Barre Gain Score Analysis " • . ' 

2) Employment Impacts ' . . ' ! 
Table A-13A, B Empfoyment Rates by Ri*e-Pro^rafli- Work Experience ' 
Table A-14 A, "B Employment by Hours, of Participation 

Table A-15 A, B ^ployment by School and -Ethnic Status ' . 
Table A-16 Mean Wages and Earnings / ^ , • ^ 
i) Post-Proqrari^ Activity Status^ 3, * • . 

Table A-17 A, B Post-Program Status by Participant Characteristics 

Table,A-18 A, B Post-Program Status by Low Riadjng Levfel 
,^ Table A-19 A,* B p.ost-Program. Status tiy High Reading. Level " ■ 



A 



4 

191 



/ 
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• ' Table A-10 
Split-Halves Reliability 
•(Number) . ; ' - 



f \ Cambridge Pre-tests Cambridge Pre-te§ts " Wi 1 kes-Barre 

ETS' Measures • ^ Exlaeri mental ^Contrqls ■ " Pre-tests 

^Vocational Attitude > .64 (136) .66(48) • ^ .78(301) 

-Job Knowledge ,- ' * .47 (133) ' ^ .47.(55) .59,'"(306lJ 

Job Hblding Sk+lls ' ' .47'(147) . .40 (59) ^.50 ( 330) 

f. . Work Relevant Attitudes .70 (155) .67 (60) .83 (346)* 

. Job 5eeking<SldTls .69 (134) . . .78 (52) . .62 (^22) 

■ S*ex Stereotyping- , ' .87 (160> - .89 (60) .'93 (351) 



Self-Esteero-^--^ ' .37 (145) '.38 (61) . ' .61 (330) 
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y Table A-ll Part A 

it 

(List 1 Control Variables— See Below) 



Wilkes-Barre Gain Score Analysis— Adjusted Post-Test Means 



*Sca^e 

•Vocational Attitudes 
Job Knowledge 
Job Holding 
Work' Attitucfes 
Job Seeking Skills . 
Sex .Stereotyping 
Self-Esteem 



Group 1 vs. Groups 2 & 3 
- (combined) 



Group 2 vs. Groups 1 & 3 
_^ {combiniaci) 



22.99 \ 
2*3.79 


23.05 
23. W 


23.23 
24.18 


•22.'92 
' 23,47 


. - ,. 22.84 
■ 23.13 


30.86 


30.64. 


31 .05 


30.52 

• 


30.16 ( 
50.26 .1 


51.53 


,5K01 


'50.71 


*. 5b.9-r ■ 


12.95 


12.45 


12.88 


12.45 


■11.93 ^ 


47.05 


45.60 


4&.27 


■ 45.96 


44.80 


36.04 ■ 


36.22 


.36.17 


•00. iO 




public assistance; l^ousehold status; 


educational 


status. 




• 

■ \ 


V 


1- 





Group 3 vs. Groups 1 & 2 
- (Combined) 



23.11, 

24.00 

30.96 

51.59 

12.91 

45.50 

36.11 



134 
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Table A- 11 Part B- 



Wilkes-Barre Cov^riance Adjusted Gains* 



Scale 



Vocational Attitudes 
Tob Knowledge 
Job Holding. 
Kprk. Attitudes \ 
'job Seekii^' Skills 
Sex Stereotyping 
Self-Esteem 



Group 1 vs. Groups 2 & 3 
\^ (combined) 

'-•014. 
• • .024 
v073 
• .072 
.185* 
.161* 
-.(555 



Group 2 vs."^roups 1 & 3 
" • ■ (combined) 



'^072 
.192* 
-.176* 
.027 
.159* 
.034 
.003 



A 



Group 3 vs. Groups 1 & 2 
- (combined) 



-.062 • 
-.235* 



.266* 
.185* 



-.363* 
-.077 
• .051' 



* Difference between adjured means divided by scale standa.rd deviation. Significance is < .10. 
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Table 


A-12 


Part A ' 




f 




^ Scale 


Wilkes-Barre Gain Score Analysis— Adjusted Post- Test "Means 

' (List 2 ControWariables— See Below) ^ ' - 

Group 1 vs'. Groups. 2 & 3 , Group 2 vs. Groups 1 & 3 Group 3 vs. .Groups 1 &, 2 
(combined) (combined) (combined) 


4 


» 

Vocational AttitOdes 


/^3.30 


22.77 • 


23.23 


22.78 


22.11 


23.^26 




Job Knowledge 


' '23.87 


23.57 


24.18 


23.35 


22.69 


24.05 




Job Holding 


30.95 


* ^0.75 


31.36 


■ 30.49 


29.91 


31.17 




Work Altitudes 


' 51.85 


51.37 


52.44 


50)96 


49.86 


52.18 


• 


Job Seeking Skills 


12.81 


•12.40 


.12.98 


12.27 ^ 


11.59 


12.90 


- 


' Sex Stereotyping . 
^ ■ Self-Esteem' ' 


46.76 
- 36.08 


45.34 
36,18 


46.08 
36.45 


( 45.66 
35.97 


44.32- 
35.82 


46.41 
36.28 




* Adjusted forpre-test score. 


A 

sex, 'reading score. 


* 

income/lower living standard. 




s 








< 








* 

198 




d .197 
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Table A-12 Part B. • 
Wilkes-B^re Covariance Adjusted Gains^ 



( \ 



Scale M 


Group f vs. Groups 2 & 3 
' ,{combined) 

: * .» t ' — 


Group 2 vs. TSroups 1 & 3 
' (combined) 


'Group 3 vs. Groups 1 & 2 
(coiDbtned) 


Vocational Attitudes 
> 


..123*. 


.105* 


■ -.267* 


Job Knowledge, 


■ .081- . ' ' 


.224*' ' . 


• -.368* 


Job Holding 


.066 


^ .290* 


-.420* ■ - ✓ 


Work Attitudes 


■ .066- 


-■•.205* ■ 


-.322* 


Job Seeking Skills 


.151* 


' • .262*" 


-.485* 


Sex Stereotyping 


.157* 


• . .046 


-.232* 


Self-Esteem 


-.030 \ 


•145* . 


^ -.139* 



190 



D.ifference between adjusted means divided by scale standar^ deviation. Significance is<.10. 
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Table A-13A 
Employment, Rates by Pre-Program Work Experience 
• Cambridge (First Follow-Up) 





. Experimental 


Control 


Minority Male Experienced 


68.4 

.(19) 


56.3 * 

(16) . 


Minority Male Limited 

c 


50.0 

(10) 


46.-2 

(13) 


Non-Minority Male Experienced 

/ . 


60.9 

(23) 


55.6 

(9) 


Non-Mi noritv Malp LimitpH 

1 


. SO • 0 

' .(15) 


(13) 


Female Minority Experienced ( 


60.0 

(10) 


50.0 

(10) 


Female Minority 'Limited 


5^.0 

(22) 


33.3 

(6) 


Non-Minority Female Experienced 


82.4 

(17) 


40.0 

(10) 


Non-Minority Female Limited ^ 


^8.6 

(14) 


. 44.4 

(9) 



Definitioa - Experienced: Reported job previous^to program 

(source IPP) at more than 25 hours 
per- week, wage greater than $4.00/hour. 

Limited: Ji^ — All else. 



Comment: Celt sips are small. Nonetheless, this table shows that 
among y/outh receiving job search assistance, previous 
•worl^ experience is associated with higher employment 
rates r\particularly among minority youth.* Among* 
control \qroup youth, differences in employment rates 
t)etween youth with previous work experience and 
those witn^t work experience are also most sijnifi- ^ 
^ / cant for minonity youth. ^ ^ i ^ 
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Table A-13B (Continued) 
Employment Rates by Pre-Program Work Experience 
Wilkes-Barre (First Follow-Up) 



Cycle . 

Male - Experienced 
Male - Limited 
Females - ^Experienced 
Females - .Limited 



I 



II 



75,0 
) 




93. -3 

(15) 

58.3 

.(12) 

78.6 
(14) • 



100.0 
(7) ■ 

58.8 

(17) 

71. f 

(10) 

62.5 

.(24) 



III All. Group 



66.7 

•(6) 

68.4 

(19) • 

77.8 

(9). 

87.5- 
(14) 



80.0 

(25) 

73.0 

(51) 

68.0 

(31)' 

73.0 

(52) 



Comment: Cell sizes are small. Nonetheless, this table 
shows that previous work experience is modestly 
associated with highe'r employment rates for males 
but not for femaTes. ' . . * 
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Table A-r4A 

Employed Youth (Full- or Part-Time) at' First Follow-Up 
' " / by Hours of Participation in Program a 

Wilkes*Barre 



rrograin nours 


iarOUp 1 


uroup L 


uroup O ' 


iOtcLl 


Percent 


1-20- 


24 


25 


• 22 


71 


' 82.0 




(29) 










. 21-60 




JO 


2 . 




' ^ 67-. 0 






(1) 


. (2)* 






Bl-80 


7 


3 


3 


.13 


62>0 




(10) , 


(3). 


(8) 


(21) 




81-100 


7 


6 


■ 6. 


i9 


•68.0 




(9)- 


(10) 


• (9) 


J28) 




. >1Q0 


3 


'6 


■4 • 


13 


■ 65.0 




(3) 


(11) , 


(6) • 


■ (20') 




' / 


















• i 




• TOTAL" * 






L. 


118 


• ^ 74.0 










(159) 












V; 


* < 












\ 



Comment:fi,Cell. s'«:es ""are ^mBll.; Nonetheless^ this table shpws 
more job'finding ,among youth receiving the'fewest 
program hours in the Wilkes-Barre program. 
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Table A-14B (Continued) ' ' 

Employed Youth (Full- or Part-Time) at First EolloW-Up . * 
by. Hours Partictpation in Program 

I ^ ' ; Cambridge Job Factory 



Program Hours Number Percent 



1-42 14 ' . 67.0 

. (21) • • 

43-76 -30 77.0 
(39) ^ 

77-110. '20 .67.(r 
. (30) ^ 

111-169 . 21 54.0 
(39) 



Comment: Cell sizes are small. Nonetheless, the table shows more 
» job finding among yeyth In the" program 1-76 hours than 
among youth in the program 77 or.mor6 hours. * ^ 
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TabTe A-_15A 
Wilkes-Barre 

Percent Employed Full- or Part-Time atrirst Follow-Up 
. by School and Ethnic Statujs 



c 



(Number) 



Group 1 ^ Group 2 ^ ^roup 3 



Total^ 
Percent 



Male Dropout 


50.0 
(4) 


100.0 

(2) 


50.0 

(2) 


63.0 

. (8) 


Male, Graduate 

• • 


87.5 

(8) 


85.7 
.(6) 


66.7" 

^ (3) 


82 ."0 

(17) 


Female Dropout 


100.0 

-(2) 






100.0 

. (2) 


Female Graduate 


100.0 • 
(5) 


83.3 • 
(12) 


- 71.4 

• (7) 


83.0 

(24) 


Male & Female Dropouts ^ 


• 66.7 

(4) . 


100.0 

ii) 


50.0 


76.0 

(8). 


Non-Dropout 


78.7 

(47) 


(56.7 
(60) 


- 77.1 
(48) 


74.0 

. (155) 



Comment: Cell §izes are small. Nonetheless, the table shows that in 
Wilkes-Barre, the employment rates among .graduates and 
drop-outs are similar. Females have higl^er employment rates 
than ma)es. 
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Table A-15B( Continued) 
Cambridge 

Percent Emploj^ed Full-, or Part-Time at First Follow-Up 
/by School and Ethnic Status 



(Number) 





bonuro 1 


txpenmenta i 


Non-Minority Male Graduates 


- 50.0 
(14) 


50.0 • 

(20) 


Non-Minority Male ^Dropouts 


50.0 

■ (6) 


57.1 
(14) 


Minority Male Graduates 


52.6 
(19) 


52.6 

(19) 


"Minority Male Dropouts 


50.0 

(10) ^ 


80.0 

^ (10.) ., 


i ' ' ' 

^Non-Minority female Graduates 


4^.9 

• (14) 


. 82.6 

(23) . 


Non-Minority Female Dropouts 


'25.0 ' 
(4) 


66.7 
* (6) 


Minority Female Graduates 


36.4 

•(.11)- 


56.5' 
(23) 


Minority. Female Dropouts 


60.0 

(5) 


44.4 

(■9) 


" All Minorities 


48.9 

.(45) 


:. m _ 


All Non-Minorities . , 


44.7 

(38) . 


65.1 

(63). • 


All High School Graduates 


63.3 

(90) 


47.5 

-(61) 


AIT High School Dropouts* 

» 1 


62.5 
(40) 


: 48. (f; 

<25) 




20e *' 


* 
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Comment: Cell sizes are small.' Nonetheless, the taBTe^hows* the 

following for Cambridge.. First, bo%h minorities and non- - 
minorities who went tbrough the ji>b search assistance ,(JSA) 
haiv.e higher employment rates than control group memtJers; 
the differences between JSA and control group members ' 
are larger among non-minorities than minorities. Second, 
by school status -alone, there is no advantage to J5A. 
Third, combining ^school status with ethnicity, the 
foil owing 'notable patterns are evident: Employment rates 
are higher among non-minority female graduates than among 
minority female graduates. In the case of dropouts, ^ 
male minorities do better than other groups. Jn terms of 
experimental -control group differences, the largest 
^advantage among males is for minority male dropouts. 
Minority female graduates do benefit from JSA over their 
control group counterparts, whfle minority female dropouts 
in the control group actually do j)etter than their JSA - 
counterparts. 
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. *\ . Jable A-ISA ' 

CimbKdge: Mean Wages and Earnings at First Follow-Up 



-Cycle 


Control 
1 


Cycl e Control 
2 2 


Cycje 
3 


# 

Wages ($/hour) $ ^3.15 


< 

'■ •3.36 


' 3.78 ' 3.46 


.3.84 


Hours 36.8 


' 33.18 


34.85 31.11 


36.69 


Earnings •$ 115.9^ . 


109. .49 


-131.73 ^07. 64 


140.89 


N - * . 21 


U 


. 21 9 


- 






Experimental 


• 

Control 


Cambridge Total Wages 

*. 


• $ 3.58 


-3.64 


Hours 


36.17^ ~ 


33.65 


# ' , Earnings . 


■ $ 129.49 


1*22.49 




N = 


.^-^ 71 


35 



3.59 
38.6 



10 



Cycle Control 
4 4 



- Table A-15B 
Wilkes-Barre: Mean Wages and Earnings at>-Pirst Folldw-Up 



Mean Wages ($/hour) , % 3". 00 
^-Mean Hours 24.6 



■3.81 " - ,4.68 
35.2 29.4 
134.11 137.59* 



Mean .Earnings 
N = 



$' 73.80 



2.98 


,3.14 




26.1 


25.24 


1 

V 


77.78 ■ 


78.25 




33 


' 31 





CQfnment: The text reports median- earnings. This table /presents mean values. The 
latter are consistent with thft interpretation/fn the text of the report. 
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. Table A-17A . ' ' ' * ' 

First Foil ow-Up: Post-Program Status by Participant Characteristics 

Cambridge 



./7 



3- 



ALL 



Experimental 

' N 
*Row % 
Col % 

Control 

N 

Row% 
Col % 

Total N 
% Total 



Full -Time 
Work 



54 

53'. 5 
67.5 



26 • 

37.1 

32.5 

80 

46.8 



Part-Time 
In School 



4 

4.0 

66.7 



2 

2.9 
33.3 

6 

3.5 



Part-Time . 
Out of School 



7 • 
6.9 
53.8 



6 • 
8.6 
46.2 

U \ 
7.6 



School 
Only 



8 ' 
7.9 
57.1 



6 

8;6 
42.9 

14 
8.2 



No Work 
No Schoo.l 

— 7 <r 



28 

"27.7 
48.3 * 



30 

42.9. 
51.7' 



58-" 
33.9 



X? = 5.458 
/.d.f. 

/Sig. = 0.2435 



MALES 



/■A 



Full -Time 

■ 'Work*- 



Part-Time 
In-S^ool 



Part-Time 
Out of School 



School. 
Only 



No Work 
No School 



Experimental 



N 


27 


1- 


2 ' ^ 


7 


16 


Row % • 


50.9 


1.9 


■ 3;8 


13.2 . 


30.2 


ZoV% 


64.3 . 


, , 33.3 


.33.3 


. 63.6V. 


53.3 


Control 












^. N 


.15 


2 




4 


14 


■ Row %^ ' 


38.5 


• 5.1 


■ 10.3 


■10.3 


35.9 


Col % 


35.7 


66.7 V 


66.7 


3'6.4 


46.7 


Total N 


42^ 




6" 


• n 


30" 


% Total 


45.7 


3.3 


<6.5\'' 


12.0 ^ 


32.6 



= 3.327 
4 d.f.. 

Sig. = 0.5047- 



First Follow-Up: Post-Program ^Status- by Participant Characteristics 



Cambridge (cont'd) 
FEMALES 



Experimental 
H 

Row % 
Col * 

Control 

N 

Row % 
Col % 

Total 'N 
% Total 



Full-Time Part-Time 
Work .In School 



27 3 
56.3 -6.3 
71.1 100.0 



11 0 
35.5 0.0 
28.9 0.0 

38 3 
48.1 ^ 3.8 

= 8.67 
4 d.f. • 
Sig. = 0.069 



Part-Time 
Out of School 



5 . 
10;4 
71.4 



2 

6.5 
28.6 

7 

8.9 



School 
Only 



1 

2.1 
33.3 



2 

6.5 
66.7 

3 

3.8 



No Work 
No School 



12 

25.0 
42.9 



16 

51.6 
57.1 

28 

35.4 



Experimental 



FulUTime 
. Work 



WHITES 

Part-Time 
In School 



Part-Time , Sch«b1 
Out of School 0 ^ Onl'y 



N 


24 


2 


4 


3 


Row % 


54.5 


• 4.5 


9.1 . 


6.8 


•Col % 


66,7 


100.0 


80.0 


'100.0 


Control 










N 


12*^ 


0 


1 . 


0 • 


Row % 


38.7 , . 


0,0 


. 3^2 


0.0 


Col, % . 


33.1 


0.0 


20.0 


0.0 


Total N 


36 


2 


5 


3- 


% Total . 


48.0 • 


2.7 


6.7 


4.0 


* 


X^* 10.553 


, # 








4 d.f. 










Si^g. 0.032 









J 



No Work 
No' School 



25:0 
37. § 



58.1^ 
62.1-^ 

29 

38.7 V 
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Firsl Follqw-Up: . 'Post-Program' Status bj^ Participant Characteristics 
' Cambridge (cont'-d) 



MINORITY 



Experimental 

'. -n 
Row % 
: ' CoJ :% 

Control ' 

N> . 
Row % 
, 'Collft 

Total N 
% Total 



Full-Time , Part-Time 
• .Work I i^School 



27 

51.9 

67.5 



13 • 
36.1 
32.5 

40 • 
45.5 



2 

50.0 



X*" - 4.422 
4 d.f. 

Sig. = 0.352 




r a r L-» i i me 


ocnooi 


NO worK 


Out of School 


On! V 


No School 


3 


4 


16 - 


5.8 


7.7 


30.8 


a7.5 


.40.0 


61.5 


5 


.6 


10 


13.9 , 


^ 16.7 


27,8, 


62.5-^—=^ 


.60.0 


38.5 


8 


• 10 


"26 


9.-1 


11.4 


29.5 



LOWER LIVING STANDARD EQUALS 70% OF DMB STANDARDS 
FOR FAMILY INCOME 



-Full -Time 
.Work. 



Part-Time 
In School 



• Part-Tirtie 
Out of School 



School 
" Only • 



No Work 
No School 



Experimental 
N 

Row % 
Col % 

Control 

N 



Total 



24 
53.3 

60.0> 



16 



1 

2.2 
33.3 



1 

2.2 
50.0 



3 

6.7 
75^0 



16 

35.6 
59.3 



11 



Row % 


51.6 


6.5 


3.2 ' 


3.2 


35.5 


Col % 


4a. 0 


66.7 


50.0 


25.0 


40.7 


N 


40 


3 


, -2 • 


4 


27 


% Total 


52,6 

2 < 
r = 1 .325 - 
4 d.f. 


3.9 

* 


2.6 


5.3 


35.5 

« 




Sig. = 0.8.57 

* 
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FirstTol low-Up: Post-Program Status by Participant Characteristics 

•» * . ... 

' Cambridge (cont'd) ' r ' 

LOWER LIVING STANDARD IS GREATER tHAN. 7.0% OF 0MB STANDARD 



FOR FAMILY INCOME 



Full^Time 
•Work 



Experimental 
N 

Row % ^ 

Col % 
Control 

■I 

N ; , 

RoW'.^t 
Col % 

Total N 

% Total 



Part-Time 
In School 




12 

40.0- 

X^-= 7.957 ' 
4 d.f. 

Sig. = 0.0932 



.Part-Time 
Out of School 



.school 
_Onl^ 



No Work 
No School 



2 


2'. 


Z 


'5 


9.1 


' 9.1 ■- 


■ 9.1 . 


22.7 


100.0 


100.0 


100.0 


. . 45.5 


0 


1 


•0 


^ 6 


0.0 


12.5 


0.0 


75.0 


0.0 


33.3 


a;o 


' 54.0 


2 


3 


2 


■ 11 


6.7 


10.0 


6.7' ' 


36.7 



ERIC 



COMMENTS ON TABLE A-17A ' ' • • ' s " 

Cambridge: The shoVt-term advantage in employment attributab^le to JSA is- 
evident from this summary table. A higher proportion of JSA youth work 
full-tftne than control group youth. -About equal numbers of JSA an% control 
group youth are out-pf-school and working part-time. Compariils JSA to 
control group youth, nearly «qual numbers of youth go to school fuU- or 
part-time (although the program was not intended to return youth to school). - 
Finally, the categbry of "neither Working nor in school" (some have referred 
to this as a "high ri^k" group)' is considerably lower among JSA youth. Thus, 
J5A increases full-time work apd reduces the "at-risk" group .in the short run. 

Consider now the post-program activities by sex, raini^l^ty statu%, and " * 
lower living standar^ds. There are some important variations. Most- notably, 
JSA's advantage in reducing the "high risk'' category is more -pronounced for 
females than, males.- Also the' school effects appear to be concentrated among 
males. There'' are no important dffferehces, hpwever, by sex 6r ethnicity in the 
fulVtime working category. More mino^ty youth, however, appear to fall into 
the "at risk" category, regardless of JSA treatment. Finally, by 0MB lower 
^living standards, -it is evident that proportionately more- JSA 'youth 
thanYontrol group.youth fintt-full-time jobs from higher family 



■ 21 



income backgrounds (greater than 70% of Lower/Uving Standard) than ^. 
JSA-'control comparisons among ,youth" with low family incomes. Alf youth 
in the study were CETA-incom^ el igibl e. , These experiments, refer to 
variations- within the Ipwer income population. ^Similarly, coitipar^g 
the proport4;©n of JSA'youth relative to control youth who fl'eit'fier-work 
nor attend. school , shows that JSA does not reduce the ,"rie1ther" category 
if they^come ' from very Ifw family- incomes . . " ' . 
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^ " - Table A-i7B (Continued),^ 

First Follow-Up: Post-Program Status by Part i^ci pant Characteristics 

Wilkes-Barre 



TOTAL 



Group 1 ' 
N 

Row % 
--~5<<ol % 

Groups- 2 & 3 



Full -Time 
Work ' 



11 

28.9, 
30.6 



Part-Time 
In School 



Part-Time 
Out. of School 



12 
31. 
34 



0 

0.0 
0.0 



Scho'ol 
Only 



13 

34.2. 
37.1 



No Work . 
No School 



2 

5.3 
12.5 



. Row % 
Col %^ 


25 

•27.8 
69.4 




23 ^ 

25.6 

65.7 




6 

6.7 

100.0- 


22 

24.4 
62.9; 


14 ■ 

15.6 

87.5^ 


Total N 
% Total 


•36 
28.1 




18.0 
27.3 




6 

, 4.7 


35 
27.3 


16 

12.5 






6.097 


4d.f/ 


Sig. 


• \ 
= 0.192 


- 


• 


Group 3 
















N ' • 
F!&w %. 
Col % 


11 
■ 25.0 
30.0 




• 14 
31.8 
4D.0 




' 3 
6.8 ' 
50.0 


8*- 
18.2 
22.9 


8 •• 

• 18:2 ; 

• .50.0 


Groups 1 & 2 


•r. 














> > 

N 

Row % 

Col % 


25 ■ 
29.8 
69.4 




21 , 
25.0 
60.0 ' 




3 ' " 
,3.6 
50.0 ' . 


27 

32.1 
' 77.1 


8 

• 9.5 
• 60.0 


Total; N ■ , 
% Total 


36 

28.1 


• 

1 


35 

27.3 




6 

/ 4.7- . ^ 


35 

.27.3 


• 16 0 * 






5.163 - 


4- d.f. 


Sig. 


= 0.271 ' 












✓ 




/ 
>• 

• 




/ 

* ' #* 












* 


^ 0 
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Ftrst Follow-Up; Post-Program Status by participant Characteristics 



0 - 



WUkes-Barre (cont'd) 
MALES * 



• 


Full -Time 
Work 


Part-Time 
In School 


Part-Time 
Out of School 


School 
Only • 


No Work 
No School 


Group 1 




'. ^ 




■ 




N 

Row % 

.Col % 


- 6 
'3!.6 


6 

31.6 
33.3 


_ 0 * 
* 0.0 
0.0 


5 

26.3 
45.5 


• z 

10.5 
22.2 


Groaps 2 & 3 












N 

Row % 

LOI 1* 


!2 

3!. 6 , 
7 


31-. 6' 

• 00, 1 


1 

2.6 
10^.0 


6 

15.8 
( .54.5 


.7 

^ 18.4 
77.8 


Total' N 

% TotaT- 


18,; 

"-^31. s 


18 . 
31.6 


1 

•1.8 


11 

19.3 • 


- 9 
15.8 


•v" • ' 


•X^ =' 1.727 


4 d,f. 


Sig/= 0.786 ■ 






Group 3 " ' 












N 

Row ■% 
. Col % 

Group-.! & 2^ 


• 5 ' 
23.8 
.27.8- 


'9 

42.9 ~ 
50.0 


0 

0.0 
0.0" 


' 2 
9.5 
18.2 


5 

23.8 

55.B^^ 


Row' % 
. Col % ■ . 


'13 

36.1 / 
* ' 72.2^ 


g 

25.0 
50.0 ' 


2.8 
100.0 


9 ^ 
. 25.0 
- 81,8 


11. 

44.4- • 


Total N 
% Total 


18 • 
31.6 


18 ' 
31.6 


1 

1.8 


1.1 

■ 19.3 


9 

15.8--S. 


* « 


= 5.5^ 

* 


' 4 d.f," 


Sig. 0.235 ' 

1 








* 
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First Follow-Up: Pos^rbgram Status by Participant Characteristics 

Wilkes-Barre (cont'd)' ^ 

•FEMALES *■ ' 

' Full-Time Part-Time"^ Part-Time Sqhool No^Wor-k- 



Group 1. ' y 

N 5 
Row % • 26.3 
Col %- '- — 27. 8 ' 

6rouf>s 2- & 3' 

N ' ■ 13 
. Row % 2'5.0 
■ Col % 72.2 

Total' N ■ ■ ■ 18 • 
% Total 25.4^ 

= 5.555 



Group 3 

N > _J_ 6 

Row % ' 26.1 • 

r.n1 '1 33.3 ' 

Group I & 2 

* N • 12 

Row % 25.0 

Col % 66 .'7 . 

Total ■ N .18 

^ % Total 25.4 



X2 




Work "In School Out of School Only" • .No School 



6 




0 


8 . 


0, 


31,6 




0.0 


42.1 


0.0 






0.0 


33.3 


0.0, 








ID 


1 








ou .o 


• A 5 


64 .J 




100.0 


66.7 


100. 0 


17 




5 


24 


7 


23.9 




7.0 


33.8 ■ 


9.9 


, 4- d.f. 


Sig. 


= 0.2350 
















5 




3 


. 6 


3 


21.7 




13.0 , 


' 26.1 


13 


29.4 




60.0 


-^&tO— 


42.9, 


12 


» 


2 


18 




25v0 




4.2 


37.5 


8. 3 


70.6- 




40.0 - ^. .. 


75.0 


57.1- 


17 




5 


24 


7 


23.9 




^7.0 


33.8 


.. 9.9, 






)• 




4 d.f.* 


Si a. 


= 0. -5.978 , ■ 










i - 




r 
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First FollowrUp: Post-Program Status by Participant CharacteRi sties 

Wilk*s-Barre (cont'd) 



LOWER .LINING STANDARD EQUALS, 70t OF DMB-STANDARDS 
FOR -FAMILY LNcOME ' 



Full -Time 
Work- 



Part-Time 
In School 



, P«rt-Time 
Out of .School 



School 
Only 



No Work 
No School 



Group 1 
I N 

r Row % 

Col % 
Groups 2 & 3 
N 

Row % 
CqI % 

Total N 

% Total 



Group 3 

\ N 
. Row % 
: Col % 

Groups A' h 1 c 

N, 

Row % 
- Col* 

Total N ' 
- % Total 



5 


.5 


. -.0 


3 




38.5 , 


38.5 


0.0 


23.1 


0.0^ 


33.3 , 


41.7 . 


0.0 


23.1., 


0.0 


10 • / 


7 


2 « 


10 


6 


28.6 


20.0 


5.7- ■ 


28.1 


17.1 


66.7 


58.3 


100.6 


76.9 


lob.o 


15 


12 




13 . , 


6' 


31.3 


25.0 




27.1 


12.5 












=-4.6610 


4 a.f. 


.Sig. = 0.3233 






















> 




« 7 


3 


; • 1 


• 3 


3 


41.2 


17.6 


5.9 


17.6 


. 17.6 


46.7 , 


25.0°- 


50.0 


• 2^.1 


5o;o 



25.8 "'- 
53.3 

15 

31.3 
= 3.01 



9 ' 


1 


10 


3 


.29.0 


. 3.2 


32.3 ' 


9.7 


75. 0-. 


50.0 


76.9 


50.0 


12 


Z [ 


^ 13 • . 


f^6. 


.25.0 X 


4.2 • ^ . 


- . 27.1 ». 


,12.5 


4 d.f. Sig. = 


"^.556 







1 



\ 
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First F,ollow--Up: Post-Program Status ^by Participant Characteristics 

• • 






^ Wilkes-Barre (cont'd) • 


• 






LOWER LIVING STANDARD IS GREATER THAN 70% OF 0M8- 


STANDARDS 








FOR FAMILY INCOME 


^ ^ 








• 

Full-Time , Part-Time . Part-Time 
Jiork In S.chool Out of School 


School 
un ly 


No Work 
no ocnooi 


t 


Group 1 
N 

Row % 
Col % , 

Groups ,2 4 3 


''2 3 _ 

14.3 2K4 0.0 
25.0 27.3 0.0 


7 

50.0 
- 53.8 


2 

14.3 
66.7 




N • 
Row % 
* Col % 


6- - • 2 
26.1 34.8 8J ' 
75.0 72.7" 100.0 . 


- 6 

26.1 

46.2 


1 

4.3 
33.3 . 




Total N 

% Total 


~ 8 ' 11 Z 
21.6 ' J9.7 5.4 


13 


3 

8.1 






r- = 4.776 4 . Sig. = 0.3110 






Group 3 


t 






• 


N 

Row % 
Col % 


2 . 3 ' 1 
18.2 27.3 9.1 
25.0 / 27.3 50.0 


.... 

36.4 
30.8 


1 

9.1 
*33.3 


• 


GroupSl & 2 










N 

Row % - 
Col % 


6 8 1 . 
23.1 30.8 3.8 
75.0 72.7 50.0 


9 

34.6 • 
69.2 


2 

7.7 
66.7 


• 


Total N 

% Total 


•8 11 2 
21.6 29;7 5.4 


13 

35.1 


3 

8.1 


» 


* 


= .536 • 4 a.f.Sig. = 0.97-.. 

« « 

V 

9 




# 

( 


0 
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- Table A-18A\ - - 

First Follow-Up: Post-Program Status by l-ow Scoring Readers 

Cambridge 



Full-Time Part-Time • Part-Time School No Work 
Work In School Out of School Only No School 



Experimental 



Row % 
Col X 


29 

50.0 
54.7 


^ 1.7 
33.3 


3 

5.2 
33.3 


5 

"8.6 
. 45.5 


20 

34.5 
42.6 


Control 




f 








N 

Row % 
Col X 

Total N ' 
t total 


24. 

36.9 

45.3 


2 

^3 • 1 

66.7 


. 6 

. 9.2 
, " 66.7 


6 

9.2 
54.5 


27 

41.5 
57.4 


53 

43.1 


' 2.4 


9 

7.3 


11 
8.9 


47 

38.2 



= 2.55 



4 d,f. Sig. = 0.636 



Comment:' In Cambridge, among poor readers.the JSA succeeds in having-more 
.treatment group youth find jobs than control group youth. Simi- 
larly, receiving the JSA reduces the rislc*of entering the. "no ^ 
' work, no school" status. • ^- 
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'Table A-18B 



First ;Fo1 low-Up: Post-Program Status by Low Scoring Readers 

Wilkes-Barre , , ^ 



• 


Full-Time,/ 
woric 


Part-Time 
In ocnool 


Part-Time 
uut OT ocnoO'i 


School 
Only 


GrouD 3 


7 

• -22.6 
31.8 








N 

Row % . 
Col % 


11 

35.5 
61.1 


1 

3.2 « ■ 
33.3 


16.1 
25.0 


Groups 1 & ? 










'M 

n 

Row & 
Col % 


15 

34.9 " 
68.2 


7 

16.3' 
38.9 


' 9 

'4.7 
66.7 - 


V 34.9 
■ 75.0 


Total -N 
% Total 


22 

29.7 ' 


18 

24.3 


"3 
4.1 


20 
27.0 




X*^ = 8. 21970 4 


<l-f-Sig. = 0.0839 




Group 1 










; N 
Row % 
Col % 


42.1-^ 
' .36.4 


5 

26.3 
27.8 


0 

0.0 

0.0 . 


5 

26.3 
25.0 


Groups 2 & 3 




• 






N 

Row % 
Col % 


' 14 - 
25.5 
63.6 


13 .• 

23.6 

72.2 


3 - 
5.5 
100.0 " 


15 

27.3 
.75.0 


Total N. 
% Total. 


22 

29.7 
- y2 


'J 24.3 


3 . 
4.1 


' '20 ■■ 
. '27-.0 




■? 

T = 3. 


93* 4 d.-f 


-Sig. = 0.4080 , 


5 




« 




•> 

* p 

220- 
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Table A-19A 



First Follow-Up: Post-Program Status :by High Scoring Readers 


- 








Camb'ridge 












■full -Time 
Work ■; 


Part-Time 
In School 


Part-Time 
Out of School 


Schoob 
Only 


No Work 
No School 




« 

Experimental 


r- 






V 






N 

Row % 

Col X, 


25 

58.1 
92.6 


■ . 3 
7.0 
100.0 


4 

9. 3 


3 

7.0 
100.0 


8 

18.6 
72.7 




Control 












'I / 

1 


• N 
Row % 
•Col % 


2 

40.0 
7.4- 


0 

0.0 „ 
0.0 


• 0 
. 0.0 
' 0.0 


0 

0.0 
0.0 


3 

60.0 
.. 27.3 




Total N 

% Total 


27 . 
56.3 


3 

6.3 ^ 


4 

8.3 


3 

6.3 


11 

22.9 






, x2 = 4: 


774 4 d.f. Sig..* 0.3113 














a 
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^ TabTe" A-19B.^ 



First FoVlow-Up: 



Post-Program Status by High Scoring Readers 
Wilkes-Barre - I 



Full -Time Part-Time 



Part-fime 



School 



No Work 





Work 


In School 


Out 


of School 


Only 


No School- 


uroup .0 ' 














N ' 
Row % 
Col ■% 


4' 
30.8 
•28.6 


• 3 
23.1 
17.6 




2' 

15.4 
66.7' 


3- 

23 ;1 
20.0 


1 

7.7 ^ 
20.(>. 


Groups 1 & 2 
N 

Row % 
Col % 


10 
• 24.4 
71.4 


•14 ^' 
34.;^ 
82.4 


• 


1 ' 
2.4 
33.3 


12 

29 .'3 
80.0 


y 

4 

9.8 
80.0 


Total N 
% Total 


14 

25.9 


17 . 
31.5 




3 

5.6 


15 

27.8 


5 . 
• 9. 3 






3.698 4 ^.f. 


Sig. 


♦ 

= 0.44^ 


• 




Group 1 














N 

' Row X 
Col % 


3 

' 15.8 
21.4 


7- 

36.8 
41.2 




■ 0 r 

b.o / 
0.0 r 


~" 8 
42.1 
53?. 3 


1 

^ 5.3 
20.0 


Group<,'2 & 3 




C 








4 

11.4 
J 80.0 


N 

Row % 
Col % 


11 
- ■ 31.4 
^ 78.6 


10 

28.6 
58.8 ■ ' 




3 

8.6 
100.0 


7 

20.0 
■ 46.7 


Total N 
* % Total 


14 
, 25.9 


27 

31.5 


-* 


3 

* 5.6 


15 ' 
27.8 


5 

* 9.3 



4 d.f. 



ERIC 




